Max level shown:
12024-10-19T04:15:01.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7c54fbdb-7a51-4dc5-919a-27e0b429e678 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
22024-10-19T04:15:01.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7c54fbdb-7a51-4dc5-919a-27e0b429e678 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
32024-10-19T04:15:01.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7c54fbdb-7a51-4dc5-919a-27e0b429e678 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
42024-10-19T04:15:02.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 36266309-7b69-4f95-a157-de96fb15e4de roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
52024-10-19T04:15:02.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 36266309-7b69-4f95-a157-de96fb15e4de resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
62024-10-19T04:15:02.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 36266309-7b69-4f95-a157-de96fb15e4de response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
72024-10-19T04:15:03.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6139cc6a-f7b8-4b06-b420-7f8b4d65a60d roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
82024-10-19T04:15:03.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6139cc6a-f7b8-4b06-b420-7f8b4d65a60d resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
92024-10-19T04:15:03.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2452 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6139cc6a-f7b8-4b06-b420-7f8b4d65a60d response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
102024-10-19T04:15:04.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 68cc5dbd-b3af-4958-8d5b-e156cdfde259 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
112024-10-19T04:15:04.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 68cc5dbd-b3af-4958-8d5b-e156cdfde259 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
122024-10-19T04:15:04.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 68cc5dbd-b3af-4958-8d5b-e156cdfde259 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
132024-10-19T04:15:04.860ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
142024-10-19T04:15:04.860ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
152024-10-19T04:15:04.860ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
162024-10-19T04:15:04.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
172024-10-19T04:15:04.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
182024-10-19T04:15:04.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
192024-10-19T04:15:04.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
202024-10-19T04:15:04.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
212024-10-19T04:15:04.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
222024-10-19T04:15:04.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.147652ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
232024-10-19T04:15:04.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
242024-10-19T04:15:04.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
252024-10-19T04:15:04.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
262024-10-19T04:15:04.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
272024-10-19T04:15:04.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
282024-10-19T04:15:04.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
292024-10-19T04:15:04.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
302024-10-19T04:15:04.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
312024-10-19T04:15:04.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
322024-10-19T04:15:04.874ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
332024-10-19T04:15:04.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.962845ms iteration = 36 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
342024-10-19T04:15:05.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 516d44aa-facc-4fa8-90be-395fd0e2ecdd roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
352024-10-19T04:15:05.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 516d44aa-facc-4fa8-90be-395fd0e2ecdd resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
362024-10-19T04:15:05.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2555 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 516d44aa-facc-4fa8-90be-395fd0e2ecdd response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
372024-10-19T04:15:06.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 95559d07-bcae-434b-a2a5-44d61f40a8a3 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
382024-10-19T04:15:06.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 95559d07-bcae-434b-a2a5-44d61f40a8a3 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
392024-10-19T04:15:06.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 95559d07-bcae-434b-a2a5-44d61f40a8a3 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
402024-10-19T04:15:06.823ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2071 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = 3c8b8b49-2fe3-4044-988c-3f542554fdfe response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
412024-10-19T04:15:06.824ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
422024-10-19T04:15:06.824ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
432024-10-19T04:15:06.855ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
442024-10-19T04:15:06.855ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:62992
452024-10-19T04:15:06.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62992 req_id = 8cc147a4-c24c-4263-9518-f73b3cb1b47e roles = RoleSet { roles: {} } uri = /metrics/producers
462024-10-19T04:15:06.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62992 req_id = 8cc147a4-c24c-4263-9518-f73b3cb1b47e resource = Database result = Ok(()) uri = /metrics/producers
472024-10-19T04:15:06.888ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d13f4058-195e-4aa0-9be7-8fb20b81649a
482024-10-19T04:15:06.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62992 req_id = 8cc147a4-c24c-4263-9518-f73b3cb1b47e roles = RoleSet { roles: {} } uri = /metrics/producers
492024-10-19T04:15:06.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62992 req_id = 8cc147a4-c24c-4263-9518-f73b3cb1b47e resource = Database result = Ok(()) uri = /metrics/producers
502024-10-19T04:15:06.898ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a uri = http://[fd00:1122:3344:101::d]:12223/producers
512024-10-19T04:15:06.898ZDEBGnexus: client response oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6e3c03fa-5df7-4953-afc5-0dabc01faa76", "date": "Sat, 19 Oct 2024 04:15:06 GMT"} })
522024-10-19T04:15:06.898ZINFOnexus: assigned collector to new producer collector_id = d13f4058-195e-4aa0-9be7-8fb20b81649a file = nexus/src/app/oximeter.rs:125 producer_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
532024-10-19T04:15:06.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 44401 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62992 req_id = 8cc147a4-c24c-4263-9518-f73b3cb1b47e response_code = 201 uri = /metrics/producers
542024-10-19T04:15:06.899ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "8cc147a4-c24c-4263-9518-f73b3cb1b47e", "content-length": "41", "date": "Sat, 19 Oct 2024 04:15:06 GMT"} })
552024-10-19T04:15:06.900ZDEBGnexus (producer-registration-task): registered with nexus successfully
562024-10-19T04:15:06.900ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
572024-10-19T04:15:07.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 21fdf4e9-bac0-4967-a4b4-8111c30709cc roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
582024-10-19T04:15:07.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 21fdf4e9-bac0-4967-a4b4-8111c30709cc resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
592024-10-19T04:15:07.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1840 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 21fdf4e9-bac0-4967-a4b4-8111c30709cc response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
602024-10-19T04:15:08.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 65e3c103-a94c-4489-b9c1-922941d3bbbb roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
612024-10-19T04:15:08.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 65e3c103-a94c-4489-b9c1-922941d3bbbb resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
622024-10-19T04:15:08.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 65e3c103-a94c-4489-b9c1-922941d3bbbb response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
632024-10-19T04:15:09.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 438f8f00-df00-450a-a6df-526f6d330fa1 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
642024-10-19T04:15:09.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 438f8f00-df00-450a-a6df-526f6d330fa1 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
652024-10-19T04:15:09.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 438f8f00-df00-450a-a6df-526f6d330fa1 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
662024-10-19T04:15:10.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a00c0e6a-de0f-41ed-9bb1-b6e28419d00a roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
672024-10-19T04:15:10.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a00c0e6a-de0f-41ed-9bb1-b6e28419d00a resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
682024-10-19T04:15:10.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a00c0e6a-de0f-41ed-9bb1-b6e28419d00a response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
692024-10-19T04:15:11.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 823f129f-3891-4a07-b77e-74eb68a57f1c roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
702024-10-19T04:15:11.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 823f129f-3891-4a07-b77e-74eb68a57f1c resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
712024-10-19T04:15:11.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1849 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 823f129f-3891-4a07-b77e-74eb68a57f1c response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
722024-10-19T04:15:12.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 771587e9-cbc9-4ea4-82a6-50aee51c69b3 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
732024-10-19T04:15:12.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 771587e9-cbc9-4ea4-82a6-50aee51c69b3 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
742024-10-19T04:15:12.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 771587e9-cbc9-4ea4-82a6-50aee51c69b3 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
752024-10-19T04:15:13.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 17732b96-f9cc-48d2-82c8-778f8bc300f6 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
762024-10-19T04:15:13.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 17732b96-f9cc-48d2-82c8-778f8bc300f6 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
772024-10-19T04:15:13.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1855 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 17732b96-f9cc-48d2-82c8-778f8bc300f6 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
782024-10-19T04:15:14.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 8ba47f25-fd91-4497-9d14-f484a13b52c6 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
792024-10-19T04:15:14.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 8ba47f25-fd91-4497-9d14-f484a13b52c6 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
802024-10-19T04:15:14.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 8ba47f25-fd91-4497-9d14-f484a13b52c6 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
812024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
822024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
832024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
842024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
852024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
862024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
872024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
882024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
892024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
902024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
912024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
922024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
932024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
942024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
952024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
962024-10-19T04:15:14.860ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931
972024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
982024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
992024-10-19T04:15:14.860ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
1002024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.58\u{b5}s iteration = 8 status = {"error":"blueprint disabled","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931"}
1012024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1022024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
1032024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
1042024-10-19T04:15:14.860ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
1052024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1062024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
1072024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1082024-10-19T04:15:14.860ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-19 04:05:14.860210448 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1092024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1102024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
1112024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
1122024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1132024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
1142024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1152024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
1162024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
1172024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1182024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
1192024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1202024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
1212024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
1222024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1232024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1242024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
1252024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1262024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
1272024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1282024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1292024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1302024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1312024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
1322024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
1332024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
1342024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1352024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1362024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1372024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
1382024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
1392024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1402024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1412024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1422024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1432024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
1442024-10-19T04:15:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1452024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1462024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1472024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1482024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1492024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1502024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1512024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1522024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1532024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1542024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1552024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1562024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1572024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1582024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1592024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1602024-10-19T04:15:14.861ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("077283a3-2f69-419e-8ab2-1088c51300c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f0b5b4d-c580-4418-9bbc-5d1b6d257b94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a79265b8-3f31-40c4-bdbb-3f2463bd3c30.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a79265b8-3f31-40c4-bdbb-3f2463bd3c30.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 8680, tv_nsec: 970277655 } })
1612024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1622024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1632024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1642024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1652024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1662024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1672024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1682024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1692024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1702024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1712024-10-19T04:15:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1722024-10-19T04:15:14.862ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3881ebd6-060e-4a3f-8035-5fd76566e5d0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4ba9b73a-0f82-489d-a9fb-902be604440b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("4ba9b73a-0f82-489d-a9fb-902be604440b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 8680, tv_nsec: 971292435 } })
1732024-10-19T04:15:14.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1742024-10-19T04:15:14.863ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
1752024-10-19T04:15:14.863ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.016069ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
1762024-10-19T04:15:14.863ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
1772024-10-19T04:15:14.863ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.773055ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
1782024-10-19T04:15:14.863ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1792024-10-19T04:15:14.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1802024-10-19T04:15:14.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1812024-10-19T04:15:14.863ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.237384ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1822024-10-19T04:15:14.864ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
1832024-10-19T04:15:14.864ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1842024-10-19T04:15:14.864ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1852024-10-19T04:15:14.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1862024-10-19T04:15:14.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1872024-10-19T04:15:14.864ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
1882024-10-19T04:15:14.864ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
1892024-10-19T04:15:14.864ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 4.444687ms iteration = 7 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
1902024-10-19T04:15:14.865ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1912024-10-19T04:15:14.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.121741ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1922024-10-19T04:15:14.865ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1932024-10-19T04:15:14.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1942024-10-19T04:15:14.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.398577ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
1952024-10-19T04:15:14.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1962024-10-19T04:15:14.866ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8680, tv_nsec: 975362395 } })
1972024-10-19T04:15:14.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
1982024-10-19T04:15:14.866ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1992024-10-19T04:15:14.866ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2002024-10-19T04:15:14.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2012024-10-19T04:15:14.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2022024-10-19T04:15:14.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2032024-10-19T04:15:14.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2042024-10-19T04:15:14.866ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
2052024-10-19T04:15:14.866ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2062024-10-19T04:15:14.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2072024-10-19T04:15:14.866ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2082024-10-19T04:15:14.867ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2092024-10-19T04:15:14.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 7.155431ms iteration = 13 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
2102024-10-19T04:15:14.867ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2112024-10-19T04:15:14.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2122024-10-19T04:15:14.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2132024-10-19T04:15:14.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2142024-10-19T04:15:14.869ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.643ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
2152024-10-19T04:15:14.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2162024-10-19T04:15:14.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2172024-10-19T04:15:14.869ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2182024-10-19T04:15:14.869ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
2192024-10-19T04:15:14.869ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
2202024-10-19T04:15:14.869ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 9.550998ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
2212024-10-19T04:15:14.869ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8680, tv_nsec: 978923575 } })
2222024-10-19T04:15:14.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2232024-10-19T04:15:14.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2242024-10-19T04:15:14.870ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
2252024-10-19T04:15:14.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2262024-10-19T04:15:14.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2272024-10-19T04:15:14.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2282024-10-19T04:15:14.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2292024-10-19T04:15:14.870ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2302024-10-19T04:15:14.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.410345ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
2312024-10-19T04:15:14.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2322024-10-19T04:15:14.871ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-19 04:05:14.860210448 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
2332024-10-19T04:15:14.871ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.491997ms iteration = 7 status = {"expiration":"2024-10-19T04:05:14.860210448Z","pruned":[]}
2342024-10-19T04:15:14.872ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2352024-10-19T04:15:14.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2362024-10-19T04:15:14.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2372024-10-19T04:15:14.872ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
2382024-10-19T04:15:14.872ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
2392024-10-19T04:15:14.872ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
2402024-10-19T04:15:14.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2412024-10-19T04:15:14.872ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2422024-10-19T04:15:14.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2432024-10-19T04:15:14.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2442024-10-19T04:15:14.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2452024-10-19T04:15:14.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2462024-10-19T04:15:14.873ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2472024-10-19T04:15:14.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2482024-10-19T04:15:14.873ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2492024-10-19T04:15:14.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2502024-10-19T04:15:14.873ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2512024-10-19T04:15:14.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2522024-10-19T04:15:14.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2532024-10-19T04:15:14.874ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2542024-10-19T04:15:14.874ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2552024-10-19T04:15:14.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2562024-10-19T04:15:14.874ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2572024-10-19T04:15:14.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2582024-10-19T04:15:14.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2592024-10-19T04:15:14.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2602024-10-19T04:15:14.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2612024-10-19T04:15:14.875ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2622024-10-19T04:15:14.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2632024-10-19T04:15:14.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2642024-10-19T04:15:14.876ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2652024-10-19T04:15:14.876ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
2662024-10-19T04:15:14.876ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
2672024-10-19T04:15:14.876ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
2682024-10-19T04:15:14.876ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2692024-10-19T04:15:14.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2702024-10-19T04:15:14.877ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2712024-10-19T04:15:14.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2722024-10-19T04:15:14.877ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2732024-10-19T04:15:14.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2742024-10-19T04:15:14.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2752024-10-19T04:15:14.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
2762024-10-19T04:15:14.878ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2772024-10-19T04:15:14.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2782024-10-19T04:15:14.878ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2792024-10-19T04:15:14.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2802024-10-19T04:15:14.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2812024-10-19T04:15:14.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2822024-10-19T04:15:14.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2832024-10-19T04:15:14.878ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2842024-10-19T04:15:14.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2852024-10-19T04:15:14.879ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8680, tv_nsec: 988407892 } })
2862024-10-19T04:15:14.879ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2872024-10-19T04:15:14.879ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
2882024-10-19T04:15:14.879ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
2892024-10-19T04:15:14.879ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = fb44ee4c-c5ec-4992-abdf-b6f7e2fadda5 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
2902024-10-19T04:15:14.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2912024-10-19T04:15:14.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2922024-10-19T04:15:14.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2932024-10-19T04:15:14.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2942024-10-19T04:15:14.880ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2952024-10-19T04:15:14.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2962024-10-19T04:15:14.881ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2972024-10-19T04:15:14.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2982024-10-19T04:15:14.881ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2992024-10-19T04:15:14.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3002024-10-19T04:15:14.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
3012024-10-19T04:15:14.881ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3022024-10-19T04:15:14.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
3032024-10-19T04:15:14.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3042024-10-19T04:15:14.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3052024-10-19T04:15:14.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3062024-10-19T04:15:14.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3072024-10-19T04:15:14.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3082024-10-19T04:15:14.883ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3092024-10-19T04:15:14.883ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a4077ac0-652e-4998-9c99-e66a22abccb6 dns_zone_name = oxide.test found_so_far = 0 version = 2
3102024-10-19T04:15:14.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3112024-10-19T04:15:14.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3122024-10-19T04:15:14.884ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3132024-10-19T04:15:14.884ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3142024-10-19T04:15:14.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3152024-10-19T04:15:14.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
3162024-10-19T04:15:14.885ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
3172024-10-19T04:15:14.885ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3182024-10-19T04:15:14.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
3192024-10-19T04:15:14.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3202024-10-19T04:15:14.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3212024-10-19T04:15:14.885ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3222024-10-19T04:15:14.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3232024-10-19T04:15:14.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3242024-10-19T04:15:14.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3252024-10-19T04:15:14.887ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 26.962391ms iteration = 16 status = {"physical_disks_added":0}
3262024-10-19T04:15:14.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
3272024-10-19T04:15:14.888ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
3282024-10-19T04:15:14.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
3292024-10-19T04:15:14.888ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = fb44ee4c-c5ec-4992-abdf-b6f7e2fadda5 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
3302024-10-19T04:15:14.888ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3312024-10-19T04:15:14.888ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-19 04:10:05.441343 UTC dns_group = internal generation = 1
3322024-10-19T04:15:14.888ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 28.030862ms iteration = 8 status = {"generation":1}
3332024-10-19T04:15:14.888ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
3342024-10-19T04:15:14.888ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 28.193095ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
3352024-10-19T04:15:14.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3362024-10-19T04:15:14.888ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3372024-10-19T04:15:14.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3382024-10-19T04:15:14.889ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
3392024-10-19T04:15:14.889ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.163434ms iteration = 37 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
3402024-10-19T04:15:14.889ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 29.067953ms iteration = 4 status = {"nsuccess":5}
3412024-10-19T04:15:14.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3422024-10-19T04:15:14.890ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3432024-10-19T04:15:14.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3442024-10-19T04:15:14.890ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a4077ac0-652e-4998-9c99-e66a22abccb6 dns_zone_name = oxide.test found_so_far = 1 version = 2
3452024-10-19T04:15:14.890ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
3462024-10-19T04:15:14.890ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-19 04:10:05.874167 UTC dns_group = external generation = 2
3472024-10-19T04:15:14.890ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 30.277696ms iteration = 8 status = {"generation":2}
3482024-10-19T04:15:14.891ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3492024-10-19T04:15:14.891ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3502024-10-19T04:15:14.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3512024-10-19T04:15:14.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3522024-10-19T04:15:14.893ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
3532024-10-19T04:15:14.893ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3542024-10-19T04:15:14.893ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 33.545091ms iteration = 13 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
3552024-10-19T04:15:14.894ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3562024-10-19T04:15:14.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3572024-10-19T04:15:14.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3582024-10-19T04:15:14.901ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3592024-10-19T04:15:14.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3602024-10-19T04:15:14.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3612024-10-19T04:15:14.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3622024-10-19T04:15:14.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3632024-10-19T04:15:14.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8180ea00-0a5e-4377-b19a-82e7e60b09bd, lookup_type: ById(8180ea00-0a5e-4377-b19a-82e7e60b09bd) } result = Ok(())
3642024-10-19T04:15:14.907ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3652024-10-19T04:15:14.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3662024-10-19T04:15:14.908ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 47.836912ms iteration = 13 status = 0
3672024-10-19T04:15:14.930ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-19T04:09:14.003740Z, time_modified: 2024-10-19T04:09:14.003740Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, db_silo: Silo { identity: SiloIdentity { id: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-19T04:10:05.838166Z, time_modified: 2024-10-19T04:10:05.838166Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1f4033bd55b23e094b1263660016971c2c68cc6162a83dcd709c701bd968e3c5" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, db_silo: Silo { identity: SiloIdentity { id: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-19T04:10:05.838166Z, time_modified: 2024-10-19T04:10:05.838166Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1f4033bd55b23e094b1263660016971c2c68cc6162a83dcd709c701bd968e3c5" }] }) }
3682024-10-19T04:15:14.930ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 70.04156ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"54ab3538-1bb1-4d5e-a518-5d0dec26f2d7","tls_certs":["1f4033bd55b23e094b1263660016971c2c68cc6162a83dcd709c701bd968e3c5"]}},"default_endpoint":{"silo_id":"54ab3538-1bb1-4d5e-a518-5d0dec26f2d7","tls_certs":["1f4033bd55b23e094b1263660016971c2c68cc6162a83dcd709c701bd968e3c5"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
3692024-10-19T04:15:15.000ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
3702024-10-19T04:15:15.038ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
3712024-10-19T04:15:15.052ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
3722024-10-19T04:15:15.052ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3732024-10-19T04:15:15.054ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9956c0c2-0302-41af-b9b0-5f8315538128", "content-length": "26", "date": "Sat, 19 Oct 2024 04:15:15 GMT"} })
3742024-10-19T04:15:15.054ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3752024-10-19T04:15:15.055ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3762024-10-19T04:15:15.061ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3772024-10-19T04:15:15.062ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "712fe6e6-24c7-4a35-8903-055521c71f2a", "content-length": "372", "date": "Sat, 19 Oct 2024 04:15:15 GMT"} })
3782024-10-19T04:15:15.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3792024-10-19T04:15:15.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3802024-10-19T04:15:15.068ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 zone_address = fd00:1122:3344:101::2
3812024-10-19T04:15:15.068ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3822024-10-19T04:15:15.069ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "972f58c3-f7e6-4eba-a4a6-287f032c81c1", "content-length": "26", "date": "Sat, 19 Oct 2024 04:15:15 GMT"} })
3832024-10-19T04:15:15.069ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3842024-10-19T04:15:15.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3852024-10-19T04:15:15.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3862024-10-19T04:15:15.071ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
3872024-10-19T04:15:15.073ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3882024-10-19T04:15:15.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3892024-10-19T04:15:15.074ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
3902024-10-19T04:15:15.074ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3912024-10-19T04:15:15.075ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "74a4cdc5-22fe-4831-b4ac-a3176b03f8e4", "content-length": "26", "date": "Sat, 19 Oct 2024 04:15:15 GMT"} })
3922024-10-19T04:15:15.075ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3932024-10-19T04:15:15.075ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3942024-10-19T04:15:15.076ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "854758ca-4fbc-435e-aec7-471270d8a8cd", "date": "Sat, 19 Oct 2024 04:15:15 GMT"} })
3952024-10-19T04:15:15.077ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3962024-10-19T04:15:15.077ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 217.972093ms iteration = 14 status = {}
3972024-10-19T04:15:15.146ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3982024-10-19T04:15:15.146ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b236dfc9-fa2b-45f6-9f99-f63b248c03ea", "content-length": "691", "date": "Sat, 19 Oct 2024 04:15:15 GMT"} })
3992024-10-19T04:15:15.146ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
4002024-10-19T04:15:15.146ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
4012024-10-19T04:15:15.146ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
4022024-10-19T04:15:15.148ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 288.249948ms iteration = 13 status = {}
4032024-10-19T04:15:15.150ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
4042024-10-19T04:15:15.224ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
4052024-10-19T04:15:15.224ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "387ee91e-7ca3-46ca-ad2a-4e0d71672485", "date": "Sat, 19 Oct 2024 04:15:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4062024-10-19T04:15:15.224ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4072024-10-19T04:15:15.227ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0e60a5ed-e0c0-44a0-ad92-6ff80fb6f8d6", "date": "Sat, 19 Oct 2024 04:15:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4082024-10-19T04:15:15.227ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4092024-10-19T04:15:15.228ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4102024-10-19T04:15:15.228ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 368.758353ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
4112024-10-19T04:15:15.238ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 378.273862ms iteration = 13 status = {}
4122024-10-19T04:15:15.246ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4132024-10-19T04:15:15.247ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "13a630e3-6c6d-4551-9cc3-dc63f1356dbd", "content-length": "1", "date": "Sat, 19 Oct 2024 04:15:14 GMT"} })
4142024-10-19T04:15:15.249ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4152024-10-19T04:15:15.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4162024-10-19T04:15:15.251ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 390.994002ms iteration = 13 status = null
4172024-10-19T04:15:15.260ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4182024-10-19T04:15:15.261ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f36c4b73-9322-40c7-8163-92cc12e13e49", "date": "Sat, 19 Oct 2024 04:15:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4192024-10-19T04:15:15.261ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4202024-10-19T04:15:15.263ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e946d887-0abd-4759-98ba-ebeb90edadd8", "date": "Sat, 19 Oct 2024 04:15:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4212024-10-19T04:15:15.263ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4222024-10-19T04:15:15.265ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7feb9c5e-9d4b-472f-9b71-99e54f2c450a", "date": "Sat, 19 Oct 2024 04:15:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4232024-10-19T04:15:15.265ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4242024-10-19T04:15:15.267ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4252024-10-19T04:15:15.267ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 406.932486ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4262024-10-19T04:15:15.314ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4272024-10-19T04:15:15.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4282024-10-19T04:15:15.316ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 67c66fb2-5b53-4f7b-be0b-63b92427bb54, rack_id: 7a4ab4db-4586-4060-be07-8fb242636fc1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ce7dad06-a40f-46ae-96ea-31487ccc19ce) } rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0
4292024-10-19T04:15:15.316ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4302024-10-19T04:15:15.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4312024-10-19T04:15:15.322ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4322024-10-19T04:15:15.322ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "72c45c37-515b-4dc8-bbda-021be90ccbbb", "content-length": "121", "date": "Sat, 19 Oct 2024 04:15:14 GMT"} })
4332024-10-19T04:15:15.322ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
4342024-10-19T04:15:15.322ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ce7dad06-a40f-46ae-96ea-31487ccc19ce
4352024-10-19T04:15:15.323ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4362024-10-19T04:15:15.323ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4372024-10-19T04:15:15.323ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {}
4382024-10-19T04:15:15.323ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {}
4392024-10-19T04:15:15.323ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
4402024-10-19T04:15:15.323ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4412024-10-19T04:15:15.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4422024-10-19T04:15:15.325ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
4432024-10-19T04:15:15.325ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "db2ce6e6-7074-4aba-9cc5-2eed02c8020c", "content-length": "2", "date": "Sat, 19 Oct 2024 04:15:14 GMT"} })
4442024-10-19T04:15:15.325ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
4452024-10-19T04:15:15.326ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "127d04d0-718c-4ff1-a674-d0eaee7ed5c3", "content-length": "52", "date": "Sat, 19 Oct 2024 04:15:14 GMT"} })
4462024-10-19T04:15:15.326ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0
4472024-10-19T04:15:15.326ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
4482024-10-19T04:15:15.420ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "98394b37-8af5-4d3a-b82b-024a8c4c7ae6", "date": "Sat, 19 Oct 2024 04:15:15 GMT"} })
4492024-10-19T04:15:15.420ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch = Switch0
4502024-10-19T04:15:15.420ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
4512024-10-19T04:15:15.422ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3a2a1602-342f-402d-88f9-3a5ca3f8d44f", "content-length": "667", "date": "Sat, 19 Oct 2024 04:15:15 GMT"} })
4522024-10-19T04:15:15.422ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4532024-10-19T04:15:15.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4542024-10-19T04:15:15.425ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4552024-10-19T04:15:15.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4562024-10-19T04:15:15.428ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4572024-10-19T04:15:15.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4582024-10-19T04:15:15.430ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4592024-10-19T04:15:15.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4602024-10-19T04:15:15.438ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 578.74031ms iteration = 13 status = {}
4612024-10-19T04:15:15.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6010c485-ba17-40a8-9b79-03965ac36ccc roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4622024-10-19T04:15:15.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6010c485-ba17-40a8-9b79-03965ac36ccc resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4632024-10-19T04:15:15.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1914 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6010c485-ba17-40a8-9b79-03965ac36ccc response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4642024-10-19T04:15:16.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = ba6b5929-379e-41b0-923b-5ad7b77c9b81 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
4652024-10-19T04:15:16.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = ba6b5929-379e-41b0-923b-5ad7b77c9b81 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
4662024-10-19T04:15:16.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2767 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = ba6b5929-379e-41b0-923b-5ad7b77c9b81 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
4672024-10-19T04:15:16.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 59093d47-49ba-4754-948c-2d43114209e4 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4682024-10-19T04:15:16.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 59093d47-49ba-4754-948c-2d43114209e4 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4692024-10-19T04:15:16.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 59093d47-49ba-4754-948c-2d43114209e4 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4702024-10-19T04:15:16.900ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1374 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = 741032de-f53e-4216-9005-97afaad48540 response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
4712024-10-19T04:15:17.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 16771199-57d0-4a6e-a02c-91cf7a2b1ec4 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4722024-10-19T04:15:17.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 16771199-57d0-4a6e-a02c-91cf7a2b1ec4 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4732024-10-19T04:15:17.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2643 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 16771199-57d0-4a6e-a02c-91cf7a2b1ec4 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4742024-10-19T04:15:18.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 62075976-0b8a-4bae-ba7c-00b52042ba4e roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4752024-10-19T04:15:18.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 62075976-0b8a-4bae-ba7c-00b52042ba4e resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4762024-10-19T04:15:18.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1736 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 62075976-0b8a-4bae-ba7c-00b52042ba4e response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4772024-10-19T04:15:19.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = aa90eb54-7194-4850-9a93-b8ec04847eaf roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4782024-10-19T04:15:19.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = aa90eb54-7194-4850-9a93-b8ec04847eaf resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4792024-10-19T04:15:19.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = aa90eb54-7194-4850-9a93-b8ec04847eaf response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4802024-10-19T04:15:20.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6c46824f-c49c-436d-8ac6-4de13355253c roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4812024-10-19T04:15:20.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6c46824f-c49c-436d-8ac6-4de13355253c resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4822024-10-19T04:15:20.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6c46824f-c49c-436d-8ac6-4de13355253c response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4832024-10-19T04:15:21.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 37a1d557-30eb-49e7-8bef-7801fedb099e roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4842024-10-19T04:15:21.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 37a1d557-30eb-49e7-8bef-7801fedb099e resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4852024-10-19T04:15:21.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 37a1d557-30eb-49e7-8bef-7801fedb099e response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4862024-10-19T04:15:22.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 92b12d06-1f14-4a97-9cf1-78c0a7e0500f roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4872024-10-19T04:15:22.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 92b12d06-1f14-4a97-9cf1-78c0a7e0500f resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4882024-10-19T04:15:22.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2322 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 92b12d06-1f14-4a97-9cf1-78c0a7e0500f response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4892024-10-19T04:15:23.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 49ea2c2e-4b48-498d-9427-3dde3243294e roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4902024-10-19T04:15:23.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 49ea2c2e-4b48-498d-9427-3dde3243294e resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4912024-10-19T04:15:23.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2402 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 49ea2c2e-4b48-498d-9427-3dde3243294e response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
4922024-10-19T04:15:24.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
4932024-10-19T04:15:24.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
4942024-10-19T04:15:24.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4952024-10-19T04:15:24.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4962024-10-19T04:15:24.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4972024-10-19T04:15:24.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4982024-10-19T04:15:24.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4992024-10-19T04:15:24.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5002024-10-19T04:15:24.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5012024-10-19T04:15:24.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.965709ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5022024-10-19T04:15:24.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5032024-10-19T04:15:24.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5042024-10-19T04:15:24.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5052024-10-19T04:15:24.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5062024-10-19T04:15:24.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5072024-10-19T04:15:24.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5082024-10-19T04:15:24.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
5092024-10-19T04:15:24.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5102024-10-19T04:15:24.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5112024-10-19T04:15:24.873ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
5122024-10-19T04:15:24.873ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.271501ms iteration = 38 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
5132024-10-19T04:15:24.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 71323ba9-bede-4ad7-aa5b-a30577b88d6e roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5142024-10-19T04:15:24.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 71323ba9-bede-4ad7-aa5b-a30577b88d6e resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5152024-10-19T04:15:24.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 71323ba9-bede-4ad7-aa5b-a30577b88d6e response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5162024-10-19T04:15:25.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f3fff5a8-739a-4102-a991-172dfd1b6a6c roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5172024-10-19T04:15:25.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f3fff5a8-739a-4102-a991-172dfd1b6a6c resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5182024-10-19T04:15:25.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f3fff5a8-739a-4102-a991-172dfd1b6a6c response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5192024-10-19T04:15:26.901ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1539 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = e1ad10c2-a434-4958-b9c9-f8e452710b8a response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
5202024-10-19T04:15:26.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f771b06d-4c84-4de4-a90d-9a6746f8cf38 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5212024-10-19T04:15:26.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f771b06d-4c84-4de4-a90d-9a6746f8cf38 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5222024-10-19T04:15:26.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1776 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f771b06d-4c84-4de4-a90d-9a6746f8cf38 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5232024-10-19T04:15:27.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7a69f400-ee47-4df9-b20b-5664370ca4e6 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5242024-10-19T04:15:27.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7a69f400-ee47-4df9-b20b-5664370ca4e6 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5252024-10-19T04:15:27.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7a69f400-ee47-4df9-b20b-5664370ca4e6 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5262024-10-19T04:15:29.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e0b92efc-65e6-4a7e-851a-006ea94a9306 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5272024-10-19T04:15:29.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e0b92efc-65e6-4a7e-851a-006ea94a9306 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5282024-10-19T04:15:29.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e0b92efc-65e6-4a7e-851a-006ea94a9306 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5292024-10-19T04:15:30.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ca326073-0b03-4a5d-9bc7-47922f0926ad roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5302024-10-19T04:15:30.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ca326073-0b03-4a5d-9bc7-47922f0926ad resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5312024-10-19T04:15:30.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ca326073-0b03-4a5d-9bc7-47922f0926ad response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5322024-10-19T04:15:31.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = cc91d0ef-cad1-4980-a473-1df0d806b247 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5332024-10-19T04:15:31.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = cc91d0ef-cad1-4980-a473-1df0d806b247 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5342024-10-19T04:15:31.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1869 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = cc91d0ef-cad1-4980-a473-1df0d806b247 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5352024-10-19T04:15:32.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 032c9e1c-583f-46e2-8cbe-e3de93615f08 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5362024-10-19T04:15:32.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 032c9e1c-583f-46e2-8cbe-e3de93615f08 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5372024-10-19T04:15:32.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 032c9e1c-583f-46e2-8cbe-e3de93615f08 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5382024-10-19T04:15:33.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 76bc7b55-fe5a-4f48-8917-dba6ad3c7abe roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5392024-10-19T04:15:33.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 76bc7b55-fe5a-4f48-8917-dba6ad3c7abe resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5402024-10-19T04:15:33.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1643 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 76bc7b55-fe5a-4f48-8917-dba6ad3c7abe response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5412024-10-19T04:15:34.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2f35eaa0-6e3b-4833-9968-4a05fc52506a roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5422024-10-19T04:15:34.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2f35eaa0-6e3b-4833-9968-4a05fc52506a resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5432024-10-19T04:15:34.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2f35eaa0-6e3b-4833-9968-4a05fc52506a response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5442024-10-19T04:15:34.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
5452024-10-19T04:15:34.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
5462024-10-19T04:15:34.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5472024-10-19T04:15:34.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5482024-10-19T04:15:34.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5492024-10-19T04:15:34.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5502024-10-19T04:15:34.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5512024-10-19T04:15:34.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5522024-10-19T04:15:34.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5532024-10-19T04:15:34.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.131961ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5542024-10-19T04:15:34.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5552024-10-19T04:15:34.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5562024-10-19T04:15:34.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5572024-10-19T04:15:34.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5582024-10-19T04:15:34.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5592024-10-19T04:15:34.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5602024-10-19T04:15:34.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
5612024-10-19T04:15:34.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5622024-10-19T04:15:34.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5632024-10-19T04:15:34.874ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
5642024-10-19T04:15:34.874ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.331272ms iteration = 39 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
5652024-10-19T04:15:35.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1dc1d9c6-07b4-4f65-87d4-31e6220d6d0b roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5662024-10-19T04:15:35.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1dc1d9c6-07b4-4f65-87d4-31e6220d6d0b resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5672024-10-19T04:15:35.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1914 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1dc1d9c6-07b4-4f65-87d4-31e6220d6d0b response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5682024-10-19T04:15:36.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9bca43be-8a2f-48a6-8e18-28cb4801a260 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5692024-10-19T04:15:36.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9bca43be-8a2f-48a6-8e18-28cb4801a260 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5702024-10-19T04:15:36.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2071 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9bca43be-8a2f-48a6-8e18-28cb4801a260 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5712024-10-19T04:15:36.902ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = 667e1e75-1c39-4fe5-966f-17c562b224f3 response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
5722024-10-19T04:15:37.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a7d2f4af-5cfd-4cbe-88cb-f5791c536bdc roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5732024-10-19T04:15:37.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a7d2f4af-5cfd-4cbe-88cb-f5791c536bdc resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5742024-10-19T04:15:37.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a7d2f4af-5cfd-4cbe-88cb-f5791c536bdc response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5752024-10-19T04:15:37.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 7612c197-daa1-464f-9fac-a8d05d98eb40 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
5762024-10-19T04:15:37.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 7612c197-daa1-464f-9fac-a8d05d98eb40 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
5772024-10-19T04:15:37.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 7612c197-daa1-464f-9fac-a8d05d98eb40 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
5782024-10-19T04:15:37.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 6fb0ef19-094a-4d17-bd5b-9b79b998e146 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
5792024-10-19T04:15:37.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 6fb0ef19-094a-4d17-bd5b-9b79b998e146 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
5802024-10-19T04:15:37.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2688 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 6fb0ef19-094a-4d17-bd5b-9b79b998e146 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
5812024-10-19T04:15:38.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7b5492f7-436f-4572-aee5-4650a3960c5e roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5822024-10-19T04:15:38.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7b5492f7-436f-4572-aee5-4650a3960c5e resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5832024-10-19T04:15:38.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7b5492f7-436f-4572-aee5-4650a3960c5e response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5842024-10-19T04:15:39.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a20ed8be-92f4-4ca0-ad03-84f598337e43 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5852024-10-19T04:15:39.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a20ed8be-92f4-4ca0-ad03-84f598337e43 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5862024-10-19T04:15:39.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a20ed8be-92f4-4ca0-ad03-84f598337e43 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5872024-10-19T04:15:40.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a4ae6a34-1aba-4406-a1ee-d2f1cfbf81f9 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5882024-10-19T04:15:40.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a4ae6a34-1aba-4406-a1ee-d2f1cfbf81f9 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5892024-10-19T04:15:40.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a4ae6a34-1aba-4406-a1ee-d2f1cfbf81f9 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5902024-10-19T04:15:41.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4a882e2d-54fa-4112-828b-07b7a1dc295f roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5912024-10-19T04:15:41.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4a882e2d-54fa-4112-828b-07b7a1dc295f resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5922024-10-19T04:15:41.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2339 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4a882e2d-54fa-4112-828b-07b7a1dc295f response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5932024-10-19T04:15:42.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 492ff0ea-8cb4-4d3b-85f8-4f7f3eab1115 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5942024-10-19T04:15:42.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 492ff0ea-8cb4-4d3b-85f8-4f7f3eab1115 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5952024-10-19T04:15:42.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2485 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 492ff0ea-8cb4-4d3b-85f8-4f7f3eab1115 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5962024-10-19T04:15:43.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 675497b4-f568-48fd-a291-eea462843a9c roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5972024-10-19T04:15:43.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 675497b4-f568-48fd-a291-eea462843a9c resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5982024-10-19T04:15:43.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2609 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 675497b4-f568-48fd-a291-eea462843a9c response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
5992024-10-19T04:15:43.953ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1846 instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 76bb7da7-c7c5-455b-9058-8b1f99e6001b remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6578786e-7586-41c1-bf20-f7477fe9923b uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-10-19T04:15:43.942193764Z }
6002024-10-19T04:15:43.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6578786e-7586-41c1-bf20-f7477fe9923b roles = RoleSet { roles: {} } uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
6012024-10-19T04:15:43.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6578786e-7586-41c1-bf20-f7477fe9923b resource = Database result = Ok(()) uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
6022024-10-19T04:15:43.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 23045 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6578786e-7586-41c1-bf20-f7477fe9923b response_code = 204 uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
6032024-10-19T04:15:43.980ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:33090
6042024-10-19T04:15:43.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:33090 req_id = cbba80b5-ce2f-45e8-9c4f-a95821e778ff roles = RoleSet { roles: {} } uri = /metrics/producers
6052024-10-19T04:15:43.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:33090 req_id = cbba80b5-ce2f-45e8-9c4f-a95821e778ff resource = Database result = Ok(()) uri = /metrics/producers
6062024-10-19T04:15:43.987ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1846 instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 76bb7da7-c7c5-455b-9058-8b1f99e6001b remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3109c54a-5cf4-4221-b5e8-5275311a3116 uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9 vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-10-19T04:15:43.987642019Z }
6072024-10-19T04:15:43.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3109c54a-5cf4-4221-b5e8-5275311a3116 roles = RoleSet { roles: {} } uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
6082024-10-19T04:15:43.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3109c54a-5cf4-4221-b5e8-5275311a3116 resource = Database result = Ok(()) uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
6092024-10-19T04:15:43.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6927 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3109c54a-5cf4-4221-b5e8-5275311a3116 response_code = 204 uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
6102024-10-19T04:15:44.014ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d13f4058-195e-4aa0-9be7-8fb20b81649a
6112024-10-19T04:15:44.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:33090 req_id = cbba80b5-ce2f-45e8-9c4f-a95821e778ff roles = RoleSet { roles: {} } uri = /metrics/producers
6122024-10-19T04:15:44.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:33090 req_id = cbba80b5-ce2f-45e8-9c4f-a95821e778ff resource = Database result = Ok(()) uri = /metrics/producers
6132024-10-19T04:15:44.018ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a uri = http://[fd00:1122:3344:101::d]:12223/producers
6142024-10-19T04:15:44.019ZDEBGnexus: client response oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "82918e2f-ff83-4abd-b77b-704d4f4b6f03", "date": "Sat, 19 Oct 2024 04:15:44 GMT"} })
6152024-10-19T04:15:44.019ZINFOnexus: assigned collector to new producer collector_id = d13f4058-195e-4aa0-9be7-8fb20b81649a file = nexus/src/app/oximeter.rs:125 producer_id = 44018ab1-2276-499a-80fc-369d8c87c0b9
6162024-10-19T04:15:44.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 40443 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:33090 req_id = cbba80b5-ce2f-45e8-9c4f-a95821e778ff response_code = 201 uri = /metrics/producers
6172024-10-19T04:15:44.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7fe5eb92-9c22-4051-918b-a9726aaf9728 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
6182024-10-19T04:15:44.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7fe5eb92-9c22-4051-918b-a9726aaf9728 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
6192024-10-19T04:15:44.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7fe5eb92-9c22-4051-918b-a9726aaf9728 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
6202024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
6212024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
6222024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
6232024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
6242024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
6252024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6262024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6272024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
6282024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
6292024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6302024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6312024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
6322024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
6332024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6342024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6352024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
6362024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6372024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
6382024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6392024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
6402024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6412024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
6422024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
6432024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6442024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6452024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
6462024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6472024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
6482024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
6492024-10-19T04:15:44.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6502024-10-19T04:15:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
6512024-10-19T04:15:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6522024-10-19T04:15:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6532024-10-19T04:15:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6542024-10-19T04:15:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6552024-10-19T04:15:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
6562024-10-19T04:15:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6572024-10-19T04:15:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6582024-10-19T04:15:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6592024-10-19T04:15:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6602024-10-19T04:15:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6612024-10-19T04:15:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6622024-10-19T04:15:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6632024-10-19T04:15:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6642024-10-19T04:15:44.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6652024-10-19T04:15:44.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6662024-10-19T04:15:44.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6672024-10-19T04:15:44.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6682024-10-19T04:15:44.862ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8710, tv_nsec: 972055150 } })
6692024-10-19T04:15:44.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6702024-10-19T04:15:44.862ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.03458ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6712024-10-19T04:15:44.863ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
6722024-10-19T04:15:44.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6732024-10-19T04:15:44.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.938197ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
6742024-10-19T04:15:44.864ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
6752024-10-19T04:15:44.864ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6762024-10-19T04:15:44.864ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6772024-10-19T04:15:44.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6782024-10-19T04:15:44.865ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6792024-10-19T04:15:44.865ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6802024-10-19T04:15:44.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6812024-10-19T04:15:44.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6822024-10-19T04:15:44.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6832024-10-19T04:15:44.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6842024-10-19T04:15:44.866ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6852024-10-19T04:15:44.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
6862024-10-19T04:15:44.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6872024-10-19T04:15:44.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6882024-10-19T04:15:44.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6892024-10-19T04:15:44.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6902024-10-19T04:15:44.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6912024-10-19T04:15:44.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6922024-10-19T04:15:44.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 7.505028ms iteration = 14 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
6932024-10-19T04:15:44.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6942024-10-19T04:15:44.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6952024-10-19T04:15:44.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6962024-10-19T04:15:44.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6972024-10-19T04:15:44.867ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6982024-10-19T04:15:44.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6992024-10-19T04:15:44.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7002024-10-19T04:15:44.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7012024-10-19T04:15:44.868ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8710, tv_nsec: 977813093 } })
7022024-10-19T04:15:44.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7032024-10-19T04:15:44.868ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7042024-10-19T04:15:44.868ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
7052024-10-19T04:15:44.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7062024-10-19T04:15:44.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7072024-10-19T04:15:44.869ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7082024-10-19T04:15:44.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7092024-10-19T04:15:44.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7102024-10-19T04:15:44.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7112024-10-19T04:15:44.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7122024-10-19T04:15:44.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7132024-10-19T04:15:44.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7142024-10-19T04:15:44.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7152024-10-19T04:15:44.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7162024-10-19T04:15:44.870ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8710, tv_nsec: 979323303 } })
7172024-10-19T04:15:44.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 10.454306ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7182024-10-19T04:15:44.870ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
7192024-10-19T04:15:44.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.715841ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
7202024-10-19T04:15:44.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7212024-10-19T04:15:44.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7222024-10-19T04:15:44.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7232024-10-19T04:15:44.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7242024-10-19T04:15:44.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
7252024-10-19T04:15:44.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7262024-10-19T04:15:44.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7272024-10-19T04:15:44.883ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 23.228878ms iteration = 17 status = {"physical_disks_added":0}
7282024-10-19T04:15:44.888ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
7292024-10-19T04:15:44.888ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.296008ms iteration = 40 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
7302024-10-19T04:15:44.888ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7312024-10-19T04:15:44.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7322024-10-19T04:15:44.898ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7332024-10-19T04:15:44.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7342024-10-19T04:15:44.898ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7352024-10-19T04:15:44.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7362024-10-19T04:15:44.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7372024-10-19T04:15:44.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7382024-10-19T04:15:44.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7392024-10-19T04:15:44.901ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7402024-10-19T04:15:44.902ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7412024-10-19T04:15:44.902ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7422024-10-19T04:15:44.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7432024-10-19T04:15:44.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7442024-10-19T04:15:44.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8180ea00-0a5e-4377-b19a-82e7e60b09bd, lookup_type: ById(8180ea00-0a5e-4377-b19a-82e7e60b09bd) } result = Ok(())
7452024-10-19T04:15:44.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7462024-10-19T04:15:44.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7472024-10-19T04:15:44.904ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
7482024-10-19T04:15:44.904ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7492024-10-19T04:15:44.904ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 44.897294ms iteration = 14 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
7502024-10-19T04:15:44.905ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 45.936115ms iteration = 14 status = 0
7512024-10-19T04:15:44.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7522024-10-19T04:15:44.906ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7532024-10-19T04:15:44.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7542024-10-19T04:15:44.992ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
7552024-10-19T04:15:44.992ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7562024-10-19T04:15:44.992ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c515db84-a2e6-4d87-9d44-5037f42dcb3e", "content-length": "26", "date": "Sat, 19 Oct 2024 04:15:44 GMT"} })
7572024-10-19T04:15:44.992ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7582024-10-19T04:15:44.994ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7592024-10-19T04:15:45.066ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7602024-10-19T04:15:45.066ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9cb1bcde-8877-41b9-9f93-b5c728d7a330", "content-length": "810", "date": "Sat, 19 Oct 2024 04:15:45 GMT"} })
7612024-10-19T04:15:45.066ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 245, 252, 217])), vni: Vni(8862532) }} sled = sock
7622024-10-19T04:15:45.066ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
7632024-10-19T04:15:45.066ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
7642024-10-19T04:15:45.068ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 208.14692ms iteration = 14 status = {}
7652024-10-19T04:15:45.149ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
7662024-10-19T04:15:45.149ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7672024-10-19T04:15:45.149ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "79db6918-e5b8-455b-9654-38044b2c2dfe", "content-length": "26", "date": "Sat, 19 Oct 2024 04:15:44 GMT"} })
7682024-10-19T04:15:45.149ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7692024-10-19T04:15:45.151ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7702024-10-19T04:15:45.158ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7712024-10-19T04:15:45.159ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "aa07a6b5-e3d2-46d1-9d9f-af6e8b2cd7ab", "content-length": "523", "date": "Sat, 19 Oct 2024 04:15:45 GMT"} })
7722024-10-19T04:15:45.159ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7732024-10-19T04:15:45.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7742024-10-19T04:15:45.161ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7752024-10-19T04:15:45.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7762024-10-19T04:15:45.164ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7772024-10-19T04:15:45.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7782024-10-19T04:15:45.167ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7792024-10-19T04:15:45.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7802024-10-19T04:15:45.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7812024-10-19T04:15:45.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7822024-10-19T04:15:45.171ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7832024-10-19T04:15:45.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7842024-10-19T04:15:45.174ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7852024-10-19T04:15:45.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7862024-10-19T04:15:45.176ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7872024-10-19T04:15:45.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7882024-10-19T04:15:45.178ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7892024-10-19T04:15:45.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7902024-10-19T04:15:45.179ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7912024-10-19T04:15:45.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7922024-10-19T04:15:45.180ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7932024-10-19T04:15:45.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7942024-10-19T04:15:45.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7952024-10-19T04:15:45.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7962024-10-19T04:15:45.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7972024-10-19T04:15:45.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7982024-10-19T04:15:45.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7992024-10-19T04:15:45.188ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, lookup_type: ById(54ab3538-1bb1-4d5e-a518-5d0dec26f2d7) }, key: 81210b0e-67b7-4b4a-bdb5-97588cb88c67, lookup_type: ById(81210b0e-67b7-4b4a-bdb5-97588cb88c67) }, key: 81ef84b8-352f-4e9d-b651-bee75fbbe45b, lookup_type: ById(81ef84b8-352f-4e9d-b651-bee75fbbe45b) }, key: 7de9c715-3de3-4a23-b1f7-837ee30892bd, lookup_type: ById(7de9c715-3de3-4a23-b1f7-837ee30892bd) } result = Ok(())
8002024-10-19T04:15:45.188ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8012024-10-19T04:15:45.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8022024-10-19T04:15:45.190ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 zone_address = fd00:1122:3344:101::2
8032024-10-19T04:15:45.190ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8042024-10-19T04:15:45.190ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9a976125-f0a6-464f-b47a-e268748714fe", "content-length": "26", "date": "Sat, 19 Oct 2024 04:15:44 GMT"} })
8052024-10-19T04:15:45.190ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8062024-10-19T04:15:45.192ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
8072024-10-19T04:15:45.193ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8082024-10-19T04:15:45.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8092024-10-19T04:15:45.196ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/instances/44018ab1-2276-499a-80fc-369d8c87c0b9/state
8102024-10-19T04:15:45.196ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = instance_watcher result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/instances/44018ab1-2276-499a-80fc-369d8c87c0b9/state", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a6210f48-6dc9-48b4-80b7-1ff395983db1", "content-length": "183", "date": "Sat, 19 Oct 2024 04:15:45 GMT"} })
8112024-10-19T04:15:45.196ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 state = Running
8122024-10-19T04:15:45.196ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:1846 instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 76bb7da7-c7c5-455b-9058-8b1f99e6001b vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-10-19T04:15:43.987642019Z }
8132024-10-19T04:15:45.196ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 roles = RoleSet { roles: {} }
8142024-10-19T04:15:45.196ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8152024-10-19T04:15:45.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 resource = Database result = Ok(())
8162024-10-19T04:15:45.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8172024-10-19T04:15:45.199ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8182024-10-19T04:15:45.204ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, lookup_type: ById(54ab3538-1bb1-4d5e-a518-5d0dec26f2d7) }, key: 81210b0e-67b7-4b4a-bdb5-97588cb88c67, lookup_type: ById(81210b0e-67b7-4b4a-bdb5-97588cb88c67) }, key: 81ef84b8-352f-4e9d-b651-bee75fbbe45b, lookup_type: ById(81ef84b8-352f-4e9d-b651-bee75fbbe45b) }, key: 7de9c715-3de3-4a23-b1f7-837ee30892bd, lookup_type: ById(7de9c715-3de3-4a23-b1f7-837ee30892bd) } result = Ok(())
8192024-10-19T04:15:45.204ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8202024-10-19T04:15:45.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8212024-10-19T04:15:45.206ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
8222024-10-19T04:15:45.206ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 346.669319ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
8232024-10-19T04:15:45.207ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8242024-10-19T04:15:45.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8252024-10-19T04:15:45.209ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8262024-10-19T04:15:45.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8272024-10-19T04:15:45.210ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8282024-10-19T04:15:45.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8292024-10-19T04:15:45.212ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8302024-10-19T04:15:45.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8312024-10-19T04:15:45.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8322024-10-19T04:15:45.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8332024-10-19T04:15:45.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8342024-10-19T04:15:45.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8352024-10-19T04:15:45.216ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8362024-10-19T04:15:45.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8372024-10-19T04:15:45.218ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8382024-10-19T04:15:45.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, lookup_type: ById(54ab3538-1bb1-4d5e-a518-5d0dec26f2d7) }, key: 81210b0e-67b7-4b4a-bdb5-97588cb88c67, lookup_type: ById(81210b0e-67b7-4b4a-bdb5-97588cb88c67) }, key: 81ef84b8-352f-4e9d-b651-bee75fbbe45b, lookup_type: ById(81ef84b8-352f-4e9d-b651-bee75fbbe45b) }, key: 04ec2ad7-647f-415d-b646-3fdb234d6ee0, lookup_type: ByName("default") } result = Ok(())
8392024-10-19T04:15:45.221ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8402024-10-19T04:15:45.222ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "94c6d35b-779e-448a-afcc-cbca01b1cac5", "date": "Sat, 19 Oct 2024 04:15:45 GMT"} })
8412024-10-19T04:15:45.223ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 364.115322ms iteration = 15 status = {}
8422024-10-19T04:15:45.247ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 387.728468ms iteration = 14 status = {}
8432024-10-19T04:15:45.253ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
8442024-10-19T04:15:45.253ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c330aec8-21c8-45bb-b66b-2b86e33f7198", "content-length": "1", "date": "Sat, 19 Oct 2024 04:15:44 GMT"} })
8452024-10-19T04:15:45.255ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8462024-10-19T04:15:45.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8472024-10-19T04:15:45.257ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 397.789476ms iteration = 14 status = null
8482024-10-19T04:15:45.334ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8492024-10-19T04:15:45.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8502024-10-19T04:15:45.336ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 67c66fb2-5b53-4f7b-be0b-63b92427bb54, rack_id: 7a4ab4db-4586-4060-be07-8fb242636fc1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ce7dad06-a40f-46ae-96ea-31487ccc19ce) } rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0
8512024-10-19T04:15:45.336ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8522024-10-19T04:15:45.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8532024-10-19T04:15:45.347ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8542024-10-19T04:15:45.347ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "372b5834-7d86-4c79-be9d-5d501c671944", "content-length": "121", "date": "Sat, 19 Oct 2024 04:15:44 GMT"} })
8552024-10-19T04:15:45.347ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
8562024-10-19T04:15:45.347ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ce7dad06-a40f-46ae-96ea-31487ccc19ce
8572024-10-19T04:15:45.347ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8582024-10-19T04:15:45.347ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8592024-10-19T04:15:45.347ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {}
8602024-10-19T04:15:45.347ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {}
8612024-10-19T04:15:45.347ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
8622024-10-19T04:15:45.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8632024-10-19T04:15:45.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8642024-10-19T04:15:45.349ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8652024-10-19T04:15:45.349ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "667f59f4-e278-4994-bf85-d489d1561e32", "content-length": "2", "date": "Sat, 19 Oct 2024 04:15:44 GMT"} })
8662024-10-19T04:15:45.349ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8672024-10-19T04:15:45.350ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "172b428b-ca95-4a0e-8908-ff0ff2853cf8", "content-length": "52", "date": "Sat, 19 Oct 2024 04:15:44 GMT"} })
8682024-10-19T04:15:45.350ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0
8692024-10-19T04:15:45.350ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8702024-10-19T04:15:45.450ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "de5856d1-69da-484e-ac20-497a8d9f11d7", "date": "Sat, 19 Oct 2024 04:15:45 GMT"} })
8712024-10-19T04:15:45.450ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch = Switch0
8722024-10-19T04:15:45.450ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8732024-10-19T04:15:45.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f6497b8e-c23c-46e6-b3eb-9c625f56c4f3 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
8742024-10-19T04:15:45.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f6497b8e-c23c-46e6-b3eb-9c625f56c4f3 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
8752024-10-19T04:15:45.451ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8a5b2348-13cf-420d-9591-d9bed36670cd", "content-length": "667", "date": "Sat, 19 Oct 2024 04:15:45 GMT"} })
8762024-10-19T04:15:45.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8772024-10-19T04:15:45.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8782024-10-19T04:15:45.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f6497b8e-c23c-46e6-b3eb-9c625f56c4f3 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
8792024-10-19T04:15:45.455ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8802024-10-19T04:15:45.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8812024-10-19T04:15:45.458ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8822024-10-19T04:15:45.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8832024-10-19T04:15:45.460ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8842024-10-19T04:15:45.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8852024-10-19T04:15:45.467ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 607.552618ms iteration = 14 status = {}
8862024-10-19T04:15:46.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4201c485-419a-4ef7-bcc1-0aa625db89d3 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
8872024-10-19T04:15:46.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4201c485-419a-4ef7-bcc1-0aa625db89d3 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
8882024-10-19T04:15:46.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4201c485-419a-4ef7-bcc1-0aa625db89d3 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
8892024-10-19T04:15:46.901ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1913 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = b4a221ed-3d9b-4537-9f22-413a9820beb4 response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
8902024-10-19T04:15:47.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 60b6f761-6a84-4b73-b951-bd1ae166f85b roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
8912024-10-19T04:15:47.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 60b6f761-6a84-4b73-b951-bd1ae166f85b resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
8922024-10-19T04:15:47.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 60b6f761-6a84-4b73-b951-bd1ae166f85b response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
8932024-10-19T04:15:48.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2858185f-5582-4b98-9006-2dbc754c569c roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
8942024-10-19T04:15:48.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2858185f-5582-4b98-9006-2dbc754c569c resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
8952024-10-19T04:15:48.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2858185f-5582-4b98-9006-2dbc754c569c response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
8962024-10-19T04:15:49.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5096a791-754e-4a20-973a-c38720787569 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
8972024-10-19T04:15:49.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5096a791-754e-4a20-973a-c38720787569 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
8982024-10-19T04:15:49.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5096a791-754e-4a20-973a-c38720787569 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
8992024-10-19T04:15:50.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 02024781-b4b7-498a-a3e0-7712959f0fa5 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
9002024-10-19T04:15:50.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 02024781-b4b7-498a-a3e0-7712959f0fa5 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
9012024-10-19T04:15:50.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 02024781-b4b7-498a-a3e0-7712959f0fa5 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
9022024-10-19T04:15:51.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2b154081-6c30-43fe-9ce9-a2eb6259b1d8 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
9032024-10-19T04:15:51.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2b154081-6c30-43fe-9ce9-a2eb6259b1d8 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
9042024-10-19T04:15:51.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2b154081-6c30-43fe-9ce9-a2eb6259b1d8 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
9052024-10-19T04:15:52.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 8b13a57a-7fe8-44a1-85fc-fa6c1feee4d9 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
9062024-10-19T04:15:52.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 8b13a57a-7fe8-44a1-85fc-fa6c1feee4d9 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
9072024-10-19T04:15:52.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 8b13a57a-7fe8-44a1-85fc-fa6c1feee4d9 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
9082024-10-19T04:15:53.527ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1846 instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 76bb7da7-c7c5-455b-9058-8b1f99e6001b remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6547749b-4066-4622-89c7-7e002ca3323b uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-10-19T04:15:53.526991365Z }
9092024-10-19T04:15:53.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6547749b-4066-4622-89c7-7e002ca3323b roles = RoleSet { roles: {} } uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9102024-10-19T04:15:53.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6547749b-4066-4622-89c7-7e002ca3323b resource = Database result = Ok(()) uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9112024-10-19T04:15:53.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 12017 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6547749b-4066-4622-89c7-7e002ca3323b response_code = 204 uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9122024-10-19T04:15:53.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6cde0644-829b-4283-b96c-f05ae1fd1d18 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
9132024-10-19T04:15:53.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6cde0644-829b-4283-b96c-f05ae1fd1d18 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
9142024-10-19T04:15:53.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1766 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6cde0644-829b-4283-b96c-f05ae1fd1d18 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
9152024-10-19T04:15:54.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 3ca7a842-c6d2-4ccd-8326-9e9820d4cdb7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
9162024-10-19T04:15:54.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 3ca7a842-c6d2-4ccd-8326-9e9820d4cdb7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
9172024-10-19T04:15:54.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3797 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 3ca7a842-c6d2-4ccd-8326-9e9820d4cdb7 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
9182024-10-19T04:15:54.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 1524ea46-3f29-47e3-8227-7b4a7653bf22 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
9192024-10-19T04:15:54.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 1524ea46-3f29-47e3-8227-7b4a7653bf22 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
9202024-10-19T04:15:54.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3679 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 1524ea46-3f29-47e3-8227-7b4a7653bf22 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
9212024-10-19T04:15:54.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a920038b-2ecf-4e39-842b-fa7476550952 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
9222024-10-19T04:15:54.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a920038b-2ecf-4e39-842b-fa7476550952 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
9232024-10-19T04:15:54.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a920038b-2ecf-4e39-842b-fa7476550952 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
9242024-10-19T04:15:54.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
9252024-10-19T04:15:54.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9262024-10-19T04:15:54.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
9272024-10-19T04:15:54.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9282024-10-19T04:15:54.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9292024-10-19T04:15:54.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9302024-10-19T04:15:54.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9312024-10-19T04:15:54.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9322024-10-19T04:15:54.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9332024-10-19T04:15:54.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.203523ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9342024-10-19T04:15:54.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9352024-10-19T04:15:54.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9362024-10-19T04:15:54.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9372024-10-19T04:15:54.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9382024-10-19T04:15:54.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9392024-10-19T04:15:54.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9402024-10-19T04:15:54.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
9412024-10-19T04:15:54.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9422024-10-19T04:15:54.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9432024-10-19T04:15:54.874ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
9442024-10-19T04:15:54.874ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.644638ms iteration = 41 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
9452024-10-19T04:15:55.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 2d342379-8757-4772-ad83-9764acc4cd38 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
9462024-10-19T04:15:55.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 2d342379-8757-4772-ad83-9764acc4cd38 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
9472024-10-19T04:15:55.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3085 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 2d342379-8757-4772-ad83-9764acc4cd38 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
9482024-10-19T04:15:55.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 84d58781-6cc9-4177-b2e6-1a4dbcbb58bb roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
9492024-10-19T04:15:55.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 84d58781-6cc9-4177-b2e6-1a4dbcbb58bb resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
9502024-10-19T04:15:55.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2387 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 84d58781-6cc9-4177-b2e6-1a4dbcbb58bb response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
9512024-10-19T04:15:55.939ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1846 instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 76bb7da7-c7c5-455b-9058-8b1f99e6001b remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a197c9f-c2e2-4ad4-9409-3759faed7b03 uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-10-19T04:15:55.938843546Z }
9522024-10-19T04:15:55.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a197c9f-c2e2-4ad4-9409-3759faed7b03 roles = RoleSet { roles: {} } uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9532024-10-19T04:15:55.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a197c9f-c2e2-4ad4-9409-3759faed7b03 resource = Database result = Ok(()) uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9542024-10-19T04:15:55.948ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 76bb7da7-c7c5-455b-9058-8b1f99e6001b remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a197c9f-c2e2-4ad4-9409-3759faed7b03 uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9 vmm_needs_update = true
9552024-10-19T04:15:55.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a197c9f-c2e2-4ad4-9409-3759faed7b03 roles = RoleSet { roles: {} } uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9562024-10-19T04:15:55.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a197c9f-c2e2-4ad4-9409-3759faed7b03 resource = Database result = Ok(()) uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9572024-10-19T04:15:55.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a197c9f-c2e2-4ad4-9409-3759faed7b03 roles = RoleSet { roles: {} } uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9582024-10-19T04:15:55.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a197c9f-c2e2-4ad4-9409-3759faed7b03 resource = Database result = Ok(()) uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9592024-10-19T04:15:55.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a197c9f-c2e2-4ad4-9409-3759faed7b03 roles = RoleSet { roles: {} } uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9602024-10-19T04:15:55.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a197c9f-c2e2-4ad4-9409-3759faed7b03 resource = Database result = Ok(()) uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9612024-10-19T04:15:55.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a197c9f-c2e2-4ad4-9409-3759faed7b03 roles = RoleSet { roles: {} } uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9622024-10-19T04:15:55.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a197c9f-c2e2-4ad4-9409-3759faed7b03 resource = Database result = Ok(()) uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9632024-10-19T04:15:55.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a197c9f-c2e2-4ad4-9409-3759faed7b03 roles = RoleSet { roles: {} } uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9642024-10-19T04:15:55.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a197c9f-c2e2-4ad4-9409-3759faed7b03 resource = Database result = Ok(()) uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9652024-10-19T04:15:55.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a197c9f-c2e2-4ad4-9409-3759faed7b03 roles = RoleSet { roles: {} } uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9662024-10-19T04:15:55.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a197c9f-c2e2-4ad4-9409-3759faed7b03 resource = Database result = Ok(()) uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9672024-10-19T04:15:55.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a197c9f-c2e2-4ad4-9409-3759faed7b03 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9682024-10-19T04:15:55.960ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a197c9f-c2e2-4ad4-9409-3759faed7b03 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, lookup_type: ById(54ab3538-1bb1-4d5e-a518-5d0dec26f2d7) }, key: 81210b0e-67b7-4b4a-bdb5-97588cb88c67, lookup_type: ById(81210b0e-67b7-4b4a-bdb5-97588cb88c67) }, key: 44018ab1-2276-499a-80fc-369d8c87c0b9, lookup_type: ById(44018ab1-2276-499a-80fc-369d8c87c0b9) } result = Ok(()) uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9692024-10-19T04:15:55.960ZINFOnexus (dropshot_internal): starting update saga for 44018ab1-2276-499a-80fc-369d8c87c0b9 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1348 instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a197c9f-c2e2-4ad4-9409-3759faed7b03 uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-10-19T04:15:55.938843546Z }
9702024-10-19T04:15:55.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 20980 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a197c9f-c2e2-4ad4-9409-3759faed7b03 response_code = 204 uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9712024-10-19T04:15:55.960ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update
9722024-10-19T04:15:55.960ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"44018ab1-2276-499a-80fc-369d8c87c0b9","lookup_type":{"ById":"44018ab1-2276-499a-80fc-369d8c87c0b9"},"parent":{"key":"81210b0e-67b7-4b4a-bdb5-97588cb88c67","lookup_type":{"ById":"81210b0e-67b7-4b4a-bdb5-97588cb88c67"},"parent":{"key":"54ab3538-1bb1-4d5e-a518-5d0dec26f2d7","lookup_type":{"ById":"54ab3538-1bb1-4d5e-a518-5d0dec26f2d7"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
9732024-10-19T04:15:55.960ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update
9742024-10-19T04:15:55.960ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1846 instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 76bb7da7-c7c5-455b-9058-8b1f99e6001b remote_addr = [fd00:1122:3344:101::1]:56868 req_id = eb02bf3e-f34a-497e-a241-ec429ee00c43 uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-10-19T04:15:55.938843546Z }
9752024-10-19T04:15:55.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = eb02bf3e-f34a-497e-a241-ec429ee00c43 roles = RoleSet { roles: {} } uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9762024-10-19T04:15:55.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = eb02bf3e-f34a-497e-a241-ec429ee00c43 resource = Database result = Ok(()) uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9772024-10-19T04:15:55.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3826 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56868 req_id = eb02bf3e-f34a-497e-a241-ec429ee00c43 response_code = 204 uri = /instances/44018ab1-2276-499a-80fc-369d8c87c0b9
9782024-10-19T04:15:55.988ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update
9792024-10-19T04:15:55.988ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
9802024-10-19T04:15:55.988ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
9812024-10-19T04:15:55.988ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37
9822024-10-19T04:15:55.992ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
9832024-10-19T04:15:55.992ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37
9842024-10-19T04:15:55.995ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
9852024-10-19T04:15:55.995ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37
9862024-10-19T04:15:55.998ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
9872024-10-19T04:15:55.998ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("d7ba57d2-855c-4ca0-8376-9a5997ff677a")) node_id = 0 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37
9882024-10-19T04:15:56.001ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
9892024-10-19T04:15:56.001ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37
9902024-10-19T04:15:56.009ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update
9912024-10-19T04:15:56.009ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = LockInstance
9922024-10-19T04:15:56.009ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = LockInstance
9932024-10-19T04:15:56.011ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = LockInstance
9942024-10-19T04:15:56.011ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = LockInstance
9952024-10-19T04:15:56.012ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = LockInstance
9962024-10-19T04:15:56.012ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = LockInstance
9972024-10-19T04:15:56.014ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = LockInstance
9982024-10-19T04:15:56.014ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = LockInstance
9992024-10-19T04:15:56.015ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = LockInstance
10002024-10-19T04:15:56.015ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = LockInstance
10012024-10-19T04:15:56.016ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = LockInstance
10022024-10-19T04:15:56.017ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = LockInstance
10032024-10-19T04:15:56.018ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = LockInstance
10042024-10-19T04:15:56.021ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, lookup_type: ById(54ab3538-1bb1-4d5e-a518-5d0dec26f2d7) }, key: 81210b0e-67b7-4b4a-bdb5-97588cb88c67, lookup_type: ById(81210b0e-67b7-4b4a-bdb5-97588cb88c67) }, key: 44018ab1-2276-499a-80fc-369d8c87c0b9, lookup_type: ById(44018ab1-2276-499a-80fc-369d8c87c0b9) } result = Ok(()) saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = LockInstance
10052024-10-19T04:15:56.021ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = LockInstance updater_id = d7ba57d2-855c-4ca0-8376-9a5997ff677a
10062024-10-19T04:15:56.021ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = LockInstance
10072024-10-19T04:15:56.021ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = LockInstance
10082024-10-19T04:15:56.027ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = LockInstance updater_id = d7ba57d2-855c-4ca0-8376-9a5997ff677a
10092024-10-19T04:15:56.027ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = LockInstance
10102024-10-19T04:15:56.028ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = LockInstance
10112024-10-19T04:15:56.030ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 locked_gen = Generation(Generation(2)) saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = LockInstance updater_id = d7ba57d2-855c-4ca0-8376-9a5997ff677a
10122024-10-19T04:15:56.030ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
10132024-10-19T04:15:56.030ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("d7ba57d2-855c-4ca0-8376-9a5997ff677a")}) node_id = 1 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37
10142024-10-19T04:15:56.033ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
10152024-10-19T04:15:56.033ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37
10162024-10-19T04:15:56.041ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
10172024-10-19T04:15:56.041ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
10182024-10-19T04:15:56.045ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
10192024-10-19T04:15:56.045ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
10202024-10-19T04:15:56.046ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
10212024-10-19T04:15:56.046ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
10222024-10-19T04:15:56.047ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
10232024-10-19T04:15:56.050ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, lookup_type: ById(54ab3538-1bb1-4d5e-a518-5d0dec26f2d7) }, key: 81210b0e-67b7-4b4a-bdb5-97588cb88c67, lookup_type: ById(81210b0e-67b7-4b4a-bdb5-97588cb88c67) }, key: 44018ab1-2276-499a-80fc-369d8c87c0b9, lookup_type: ById(44018ab1-2276-499a-80fc-369d8c87c0b9) } result = Ok(()) saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
10242024-10-19T04:15:56.050ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
10252024-10-19T04:15:56.050ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
10262024-10-19T04:15:56.055ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 76bb7da7-c7c5-455b-9058-8b1f99e6001b, time_created: 2024-10-19T04:15:36.390743Z, time_deleted: None, instance_id: 44018ab1-2276-499a-80fc-369d8c87c0b9, sled_id: 8180ea00-0a5e-4377-b19a-82e7e60b09bd, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-10-19T04:15:55.938843Z, gen: Generation(Generation(7)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-10-19T04:15:36.430766Z, gen: Generation(Generation(3)), propolis_id: Some(76bb7da7-c7c5-455b-9058-8b1f99e6001b), dst_propolis_id: None, migration_id: None, nexus_state: Vmm } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(76bb7da7-c7c5-455b-9058-8b1f99e6001b (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-10-19T04:15:56.055944563Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm }
10272024-10-19T04:15:56.063ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update
10282024-10-19T04:15:56.064ZINFOnexus (SEC): saga create dag = {"end_node":13,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[12,0,null],[11,13,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"44018ab1-2276-499a-80fc-369d8c87c0b9","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"76bb7da7-c7c5-455b-9058-8b1f99e6001b"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Start":{"params":{"authz_instance":{"key":"44018ab1-2276-499a-80fc-369d8c87c0b9","lookup_type":{"ById":"44018ab1-2276-499a-80fc-369d8c87c0b9"},"parent":{"key":"81210b0e-67b7-4b4a-bdb5-97588cb88c67","lookup_type":{"ById":"81210b0e-67b7-4b4a-bdb5-97588cb88c67"},"parent":{"key":"54ab3538-1bb1-4d5e-a518-5d0dec26f2d7","lookup_type":{"ById":"54ab3538-1bb1-4d5e-a518-5d0dec26f2d7"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"d7ba57d2-855c-4ca0-8376-9a5997ff677a"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"81210b0e-67b7-4b4a-bdb5-97588cb88c67","ram_diff":1073741824},"destroy_active_vmm":"76bb7da7-c7c5-455b-9058-8b1f99e6001b","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_updated":"2024-10-19T04:15:56.055944563Z"}}}}},"End"]},"saga_name":"instance-update","start_node":12} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
10292024-10-19T04:15:56.064ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update
10302024-10-19T04:15:56.067ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update
10312024-10-19T04:15:56.069ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
10322024-10-19T04:15:56.069ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
10332024-10-19T04:15:56.069ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
10342024-10-19T04:15:56.073ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
10352024-10-19T04:15:56.073ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
10362024-10-19T04:15:56.076ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
10372024-10-19T04:15:56.076ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
10382024-10-19T04:15:56.079ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
10392024-10-19T04:15:56.079ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("ca19c674-13a8-40d0-aae8-3c890ab48f64")) node_id = 0 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
10402024-10-19T04:15:56.082ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
10412024-10-19T04:15:56.082ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
10422024-10-19T04:15:56.088ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 parent_lock = UpdaterLock { updater_id: d7ba57d2-855c-4ca0-8376-9a5997ff677a, locked_gen: Generation(Generation(2)) } saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update
10432024-10-19T04:15:56.088ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = BecomeUpdater
10442024-10-19T04:15:56.088ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = BecomeUpdater
10452024-10-19T04:15:56.094ZDEBGnexus (SagaExecutor): inherited lock from d7ba57d2-855c-4ca0-8376-9a5997ff677a to ca19c674-13a8-40d0-aae8-3c890ab48f64 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = d7ba57d2-855c-4ca0-8376-9a5997ff677a saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = BecomeUpdater updater_id = ca19c674-13a8-40d0-aae8-3c890ab48f64
10462024-10-19T04:15:56.094ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:933 instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update
10472024-10-19T04:15:56.094ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
10482024-10-19T04:15:56.094ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("ca19c674-13a8-40d0-aae8-3c890ab48f64")}) node_id = 1 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
10492024-10-19T04:15:56.098ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
10502024-10-19T04:15:56.098ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
10512024-10-19T04:15:56.101ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
10522024-10-19T04:15:56.101ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
10532024-10-19T04:15:56.104ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
10542024-10-19T04:15:56.104ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
10552024-10-19T04:15:56.107ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:986 instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update
10562024-10-19T04:15:56.107ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9
10572024-10-19T04:15:56.109ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = UpdateNetworkConfig
10582024-10-19T04:15:56.109ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = UpdateNetworkConfig
10592024-10-19T04:15:56.112ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = UpdateNetworkConfig
10602024-10-19T04:15:56.112ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = UpdateNetworkConfig
10612024-10-19T04:15:56.116ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
10622024-10-19T04:15:56.116ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = UpdateNetworkConfig
10632024-10-19T04:15:56.116ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = UpdateNetworkConfig
10642024-10-19T04:15:56.118ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
10652024-10-19T04:15:56.118ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
10662024-10-19T04:15:56.118ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
10672024-10-19T04:15:56.119ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
10682024-10-19T04:15:56.121ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
10692024-10-19T04:15:56.121ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
10702024-10-19T04:15:56.121ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
10712024-10-19T04:15:56.124ZDEBGnexus: notifying dendrite of updates instance_id = Some(44018ab1-2276-499a-80fc-369d8c87c0b9 (instance)) switch = switch0
10722024-10-19T04:15:56.125ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8722, tv_nsec: 234533099 } })
10732024-10-19T04:15:56.125ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
10742024-10-19T04:15:56.157ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
10752024-10-19T04:15:56.157ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10762024-10-19T04:15:56.157ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3f073f0b-cde4-4e05-bd32-49cbe1f2b2f8", "content-length": "26", "date": "Sat, 19 Oct 2024 04:15:56 GMT"} })
10772024-10-19T04:15:56.157ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10782024-10-19T04:15:56.158ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10792024-10-19T04:15:56.188ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
10802024-10-19T04:15:56.188ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8b430abb-3a2d-4aed-b671-bd92710153cd", "content-length": "4", "date": "Sat, 19 Oct 2024 04:15:55 GMT"} })
10812024-10-19T04:15:56.189ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
10822024-10-19T04:15:56.189ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
10832024-10-19T04:15:56.193ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
10842024-10-19T04:15:56.193ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
10852024-10-19T04:15:56.196ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
10862024-10-19T04:15:56.196ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
10872024-10-19T04:15:56.206ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1061 instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-10-19T04:15:56.199010Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, time_modified: Some(2024-10-19T04:15:56.199010Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 81210b0e-67b7-4b4a-bdb5-97588cb88c67, time_modified: Some(2024-10-19T04:15:56.199010Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update
10882024-10-19T04:15:56.207ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
10892024-10-19T04:15:56.207ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
10902024-10-19T04:15:56.209ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
10912024-10-19T04:15:56.209ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
10922024-10-19T04:15:56.213ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1096 instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update
10932024-10-19T04:15:56.213ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = UnassignOximeterProducer
10942024-10-19T04:15:56.213ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = UnassignOximeterProducer
10952024-10-19T04:15:56.217ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = d13f4058-195e-4aa0-9be7-8fb20b81649a producer_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update
10962024-10-19T04:15:56.217ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = UnassignOximeterProducer
10972024-10-19T04:15:56.217ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = UnassignOximeterProducer
10982024-10-19T04:15:56.249ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 44018ab1-2276-499a-80fc-369d8c87c0b9 saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update
10992024-10-19T04:15:56.249ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 44018ab1-2276-499a-80fc-369d8c87c0b9 saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/44018ab1-2276-499a-80fc-369d8c87c0b9
11002024-10-19T04:15:56.250ZDEBGnexus (SagaExecutor): client response oximeter-collector = 44018ab1-2276-499a-80fc-369d8c87c0b9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers/44018ab1-2276-499a-80fc-369d8c87c0b9", query: None, fragment: None }, status: 204, headers: {"x-request-id": "60efdef3-6b02-4880-be5b-a54573b5a92e", "date": "Sat, 19 Oct 2024 04:15:56 GMT"} }) saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update
11012024-10-19T04:15:56.250ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = d13f4058-195e-4aa0-9be7-8fb20b81649a producer_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update
11022024-10-19T04:15:56.251ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
11032024-10-19T04:15:56.251ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
11042024-10-19T04:15:56.254ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
11052024-10-19T04:15:56.254ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
11062024-10-19T04:15:56.257ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 lock = UpdaterLock { updater_id: ca19c674-13a8-40d0-aae8-3c890ab48f64, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-10-19T04:15:56.055944563Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update
11072024-10-19T04:15:56.257ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = CommitInstanceUpdates
11082024-10-19T04:15:56.258ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = CommitInstanceUpdates
11092024-10-19T04:15:56.291ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1145 instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 new_runtime = InstanceRuntimeState { time_updated: 2024-10-19T04:15:56.055944563Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update
11102024-10-19T04:15:56.291ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = CommitInstanceUpdates
11112024-10-19T04:15:56.291ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Signaled
11122024-10-19T04:15:56.291ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11132024-10-19T04:15:56.292ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = CommitInstanceUpdates
11142024-10-19T04:15:56.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11152024-10-19T04:15:56.292ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Signaled
11162024-10-19T04:15:56.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11172024-10-19T04:15:56.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11182024-10-19T04:15:56.293ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = CommitInstanceUpdates
11192024-10-19T04:15:56.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11202024-10-19T04:15:56.293ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = CommitInstanceUpdates
11212024-10-19T04:15:56.294ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = CommitInstanceUpdates
11222024-10-19T04:15:56.294ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = CommitInstanceUpdates
11232024-10-19T04:15:56.295ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11242024-10-19T04:15:56.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11252024-10-19T04:15:56.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11262024-10-19T04:15:56.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11272024-10-19T04:15:56.297ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = CommitInstanceUpdates
11282024-10-19T04:15:56.299ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11292024-10-19T04:15:56.299ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11302024-10-19T04:15:56.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11312024-10-19T04:15:56.301ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, lookup_type: ById(54ab3538-1bb1-4d5e-a518-5d0dec26f2d7) }, key: 81210b0e-67b7-4b4a-bdb5-97588cb88c67, lookup_type: ById(81210b0e-67b7-4b4a-bdb5-97588cb88c67) }, key: 44018ab1-2276-499a-80fc-369d8c87c0b9, lookup_type: ById(44018ab1-2276-499a-80fc-369d8c87c0b9) } result = Ok(()) saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = CommitInstanceUpdates
11322024-10-19T04:15:56.301ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = CommitInstanceUpdates
11332024-10-19T04:15:56.301ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = CommitInstanceUpdates
11342024-10-19T04:15:56.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11352024-10-19T04:15:56.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11362024-10-19T04:15:56.310ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
11372024-10-19T04:15:56.310ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
11382024-10-19T04:15:56.315ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
11392024-10-19T04:15:56.315ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
11402024-10-19T04:15:56.316ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11412024-10-19T04:15:56.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11422024-10-19T04:15:56.317ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11432024-10-19T04:15:56.318ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
11442024-10-19T04:15:56.318ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("44018ab1-2276-499a-80fc-369d8c87c0b9"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("76bb7da7-c7c5-455b-9058-8b1f99e6001b")}) node_id = 7 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
11452024-10-19T04:15:56.319ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11462024-10-19T04:15:56.319ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11472024-10-19T04:15:56.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11482024-10-19T04:15:56.320ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11492024-10-19T04:15:56.321ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
11502024-10-19T04:15:56.321ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
11512024-10-19T04:15:56.322ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11522024-10-19T04:15:56.322ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11532024-10-19T04:15:56.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11542024-10-19T04:15:56.324ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
11552024-10-19T04:15:56.324ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
11562024-10-19T04:15:56.327ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
11572024-10-19T04:15:56.328ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
11582024-10-19T04:15:56.331ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 propolis_id = 76bb7da7-c7c5-455b-9058-8b1f99e6001b saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update
11592024-10-19T04:15:56.331ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = ReleaseSledResources
11602024-10-19T04:15:56.331ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = ReleaseSledResources
11612024-10-19T04:15:56.335ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
11622024-10-19T04:15:56.335ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
11632024-10-19T04:15:56.339ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
11642024-10-19T04:15:56.339ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
11652024-10-19T04:15:56.342ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 propolis_id = 76bb7da7-c7c5-455b-9058-8b1f99e6001b saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update
11662024-10-19T04:15:56.342ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = MarkVmmDeleted
11672024-10-19T04:15:56.342ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_node = MarkVmmDeleted
11682024-10-19T04:15:56.350ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
11692024-10-19T04:15:56.350ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
11702024-10-19T04:15:56.354ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
11712024-10-19T04:15:56.354ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
11722024-10-19T04:15:56.357ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
11732024-10-19T04:15:56.357ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
11742024-10-19T04:15:56.361ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
11752024-10-19T04:15:56.361ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
11762024-10-19T04:15:56.364ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
11772024-10-19T04:15:56.364ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
11782024-10-19T04:15:56.367ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 74810e75-6b28-4294-9442-74d172a0c174 sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
11792024-10-19T04:15:56.367ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 74810e75-6b28-4294-9442-74d172a0c174
11802024-10-19T04:15:56.374ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11812024-10-19T04:15:56.374ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "02184a16-32c0-4959-af73-61447535e698", "content-length": "372", "date": "Sat, 19 Oct 2024 04:15:56 GMT"} })
11822024-10-19T04:15:56.374ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11832024-10-19T04:15:56.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11842024-10-19T04:15:56.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11852024-10-19T04:15:56.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11862024-10-19T04:15:56.378ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11872024-10-19T04:15:56.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11882024-10-19T04:15:56.381ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11892024-10-19T04:15:56.381ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2fd38898-19db-45e6-a3ae-394a54a8a2e7", "date": "Sat, 19 Oct 2024 04:15:56 GMT"} })
11902024-10-19T04:15:56.382ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 90.777268ms iteration = 16 status = {}
11912024-10-19T04:15:56.392ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11922024-10-19T04:15:56.393ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ebed0a71-d156-4180-a344-00bcacd36fc0", "content-length": "691", "date": "Sat, 19 Oct 2024 04:15:56 GMT"} })
11932024-10-19T04:15:56.393ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
11942024-10-19T04:15:56.393ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
11952024-10-19T04:15:56.393ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
11962024-10-19T04:15:56.395ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 103.245164ms iteration = 15 status = {}
11972024-10-19T04:15:56.401ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
11982024-10-19T04:15:56.401ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = 74810e75-6b28-4294-9442-74d172a0c174 saga_name = instance-update saga_result = SagaResult { saga_id: 74810e75-6b28-4294-9442-74d172a0c174, saga_log: SagaLog { saga_id: 74810e75-6b28-4294-9442-74d172a0c174, unwinding: false, events: [N012 started, N012 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N013 started, N013 succeeded], node_status: {0: Succeeded(String("ca19c674-13a8-40d0-aae8-3c890ab48f64")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("ca19c674-13a8-40d0-aae8-3c890ab48f64")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("44018ab1-2276-499a-80fc-369d8c87c0b9"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("76bb7da7-c7c5-455b-9058-8b1f99e6001b")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("44018ab1-2276-499a-80fc-369d8c87c0b9"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("76bb7da7-c7c5-455b-9058-8b1f99e6001b")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("ca19c674-13a8-40d0-aae8-3c890ab48f64"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("ca19c674-13a8-40d0-aae8-3c890ab48f64")}} }) }
11992024-10-19T04:15:56.401ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 74810e75-6b28-4294-9442-74d172a0c174 instance_id = 44018ab1-2276-499a-80fc-369d8c87c0b9 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update
12002024-10-19T04:15:56.401ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
12012024-10-19T04:15:56.401ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37
12022024-10-19T04:15:56.404ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
12032024-10-19T04:15:56.405ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37
12042024-10-19T04:15:56.408ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
12052024-10-19T04:15:56.408ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37
12062024-10-19T04:15:56.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 5ff51a7c-976b-4d35-8132-0fbd4984bb15 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
12072024-10-19T04:15:56.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 5ff51a7c-976b-4d35-8132-0fbd4984bb15 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
12082024-10-19T04:15:56.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 5ff51a7c-976b-4d35-8132-0fbd4984bb15 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
12092024-10-19T04:15:56.411ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
12102024-10-19T04:15:56.411ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37
12112024-10-19T04:15:56.417ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update sec_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
12122024-10-19T04:15:56.417ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37 saga_name = start-instance-update saga_result = SagaResult { saga_id: 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37, saga_log: SagaLog { saga_id: 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("d7ba57d2-855c-4ca0-8376-9a5997ff677a")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("d7ba57d2-855c-4ca0-8376-9a5997ff677a")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("d7ba57d2-855c-4ca0-8376-9a5997ff677a"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("d7ba57d2-855c-4ca0-8376-9a5997ff677a")}} }) }
12132024-10-19T04:15:56.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 85dd1049-f5f9-4028-87f9-5b2d115bb73e roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12142024-10-19T04:15:56.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 85dd1049-f5f9-4028-87f9-5b2d115bb73e resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12152024-10-19T04:15:56.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1722 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 85dd1049-f5f9-4028-87f9-5b2d115bb73e response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12162024-10-19T04:15:56.900ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1814 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = 7706c546-c418-4613-939e-515946a9afad response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
12172024-10-19T04:15:57.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 247d820f-1de4-4568-aba0-d4002dffba13 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12182024-10-19T04:15:57.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 247d820f-1de4-4568-aba0-d4002dffba13 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12192024-10-19T04:15:57.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2456 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 247d820f-1de4-4568-aba0-d4002dffba13 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12202024-10-19T04:15:58.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d8d9d1f0-39af-41f9-9f25-bcd10c251e43 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12212024-10-19T04:15:58.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d8d9d1f0-39af-41f9-9f25-bcd10c251e43 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12222024-10-19T04:15:58.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d8d9d1f0-39af-41f9-9f25-bcd10c251e43 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12232024-10-19T04:15:59.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = aef64d89-a330-47bd-bec2-a0869b53463d roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12242024-10-19T04:15:59.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = aef64d89-a330-47bd-bec2-a0869b53463d resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12252024-10-19T04:15:59.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2436 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = aef64d89-a330-47bd-bec2-a0869b53463d response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12262024-10-19T04:16:00.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 15952617-1e45-411b-86b1-345f40fe50d9 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12272024-10-19T04:16:00.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 15952617-1e45-411b-86b1-345f40fe50d9 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12282024-10-19T04:16:00.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 15952617-1e45-411b-86b1-345f40fe50d9 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12292024-10-19T04:16:01.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4030243c-3ec9-4c9e-b873-69eece201279 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12302024-10-19T04:16:01.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4030243c-3ec9-4c9e-b873-69eece201279 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12312024-10-19T04:16:01.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2921 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4030243c-3ec9-4c9e-b873-69eece201279 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12322024-10-19T04:16:02.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = fc4e2428-1afb-48dc-a4f6-fb164eaccfda roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12332024-10-19T04:16:02.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = fc4e2428-1afb-48dc-a4f6-fb164eaccfda resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12342024-10-19T04:16:02.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2665 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = fc4e2428-1afb-48dc-a4f6-fb164eaccfda response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12352024-10-19T04:16:03.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5ff39032-4636-4160-b48d-0615737d0a8a roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12362024-10-19T04:16:03.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5ff39032-4636-4160-b48d-0615737d0a8a resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12372024-10-19T04:16:03.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5ff39032-4636-4160-b48d-0615737d0a8a response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12382024-10-19T04:16:04.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
12392024-10-19T04:16:04.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
12402024-10-19T04:16:04.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12412024-10-19T04:16:04.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12422024-10-19T04:16:04.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12432024-10-19T04:16:04.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12442024-10-19T04:16:04.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12452024-10-19T04:16:04.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12462024-10-19T04:16:04.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12472024-10-19T04:16:04.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.10777ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12482024-10-19T04:16:04.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12492024-10-19T04:16:04.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12502024-10-19T04:16:04.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12512024-10-19T04:16:04.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12522024-10-19T04:16:04.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12532024-10-19T04:16:04.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12542024-10-19T04:16:04.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
12552024-10-19T04:16:04.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12562024-10-19T04:16:04.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12572024-10-19T04:16:04.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 174737b5-67e7-4991-ae02-7eb4337ad313 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12582024-10-19T04:16:04.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 174737b5-67e7-4991-ae02-7eb4337ad313 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12592024-10-19T04:16:04.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 174737b5-67e7-4991-ae02-7eb4337ad313 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12602024-10-19T04:16:04.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
12612024-10-19T04:16:04.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.757191ms iteration = 42 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
12622024-10-19T04:16:05.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ccda08d1-ac9f-4e23-871e-aadc0f815d49 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12632024-10-19T04:16:05.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ccda08d1-ac9f-4e23-871e-aadc0f815d49 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12642024-10-19T04:16:05.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ccda08d1-ac9f-4e23-871e-aadc0f815d49 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12652024-10-19T04:16:06.900ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1550 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = fd60793d-3f3d-45b7-8fe6-0dddb6738e2f response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
12662024-10-19T04:16:06.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3380f4c7-5430-4379-b6f9-1284a6b1b9e4 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12672024-10-19T04:16:06.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3380f4c7-5430-4379-b6f9-1284a6b1b9e4 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12682024-10-19T04:16:06.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3380f4c7-5430-4379-b6f9-1284a6b1b9e4 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12692024-10-19T04:16:07.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = c58a395c-030d-4e26-b431-73edc836a378 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12702024-10-19T04:16:07.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = c58a395c-030d-4e26-b431-73edc836a378 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12712024-10-19T04:16:07.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = c58a395c-030d-4e26-b431-73edc836a378 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12722024-10-19T04:16:08.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ab3b232a-b744-4bce-8b59-9efbc60e57db roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12732024-10-19T04:16:08.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ab3b232a-b744-4bce-8b59-9efbc60e57db resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12742024-10-19T04:16:08.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2517 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ab3b232a-b744-4bce-8b59-9efbc60e57db response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12752024-10-19T04:16:09.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = dcbafeac-007a-41fb-ba36-ca9b89f5afc4 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12762024-10-19T04:16:09.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = dcbafeac-007a-41fb-ba36-ca9b89f5afc4 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12772024-10-19T04:16:09.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2750 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = dcbafeac-007a-41fb-ba36-ca9b89f5afc4 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12782024-10-19T04:16:11.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1a97ed6c-14fc-4d73-9816-499bd58f8841 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12792024-10-19T04:16:11.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1a97ed6c-14fc-4d73-9816-499bd58f8841 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12802024-10-19T04:16:11.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2365 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1a97ed6c-14fc-4d73-9816-499bd58f8841 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12812024-10-19T04:16:12.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a85741ed-7710-4ec8-aff9-f3442352e975 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12822024-10-19T04:16:12.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a85741ed-7710-4ec8-aff9-f3442352e975 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12832024-10-19T04:16:12.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a85741ed-7710-4ec8-aff9-f3442352e975 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12842024-10-19T04:16:13.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 17a8e65b-dbb5-4604-93b7-c3597b03f6f2 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12852024-10-19T04:16:13.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 17a8e65b-dbb5-4604-93b7-c3597b03f6f2 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12862024-10-19T04:16:13.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2407 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 17a8e65b-dbb5-4604-93b7-c3597b03f6f2 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12872024-10-19T04:16:14.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 519f475f-659b-4555-821f-3b0b0a1bad8c roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12882024-10-19T04:16:14.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 519f475f-659b-4555-821f-3b0b0a1bad8c resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12892024-10-19T04:16:14.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2733 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 519f475f-659b-4555-821f-3b0b0a1bad8c response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
12902024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
12912024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
12922024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
12932024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12942024-10-19T04:16:14.859ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931
12952024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
12962024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.91\u{b5}s iteration = 9 status = {"error":"blueprint disabled","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931"}
12972024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
12982024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
12992024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
13002024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13012024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
13022024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
13032024-10-19T04:16:14.859ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
13042024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13052024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
13062024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
13072024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
13082024-10-19T04:16:14.859ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-19 04:06:14.859372112 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
13092024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
13102024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13112024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
13122024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13132024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
13142024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
13152024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13162024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
13172024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
13182024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
13192024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13202024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13212024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
13222024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13232024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
13242024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13252024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
13262024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
13272024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
13282024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13292024-10-19T04:16:14.859ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
13302024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
13312024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
13322024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
13332024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13342024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
13352024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13362024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13372024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13382024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
13392024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13402024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
13412024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
13422024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
13432024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
13442024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
13452024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13462024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13472024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13482024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13492024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
13502024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13512024-10-19T04:16:14.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
13522024-10-19T04:16:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13532024-10-19T04:16:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13542024-10-19T04:16:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
13552024-10-19T04:16:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13562024-10-19T04:16:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13572024-10-19T04:16:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13582024-10-19T04:16:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13592024-10-19T04:16:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13602024-10-19T04:16:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
13612024-10-19T04:16:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13622024-10-19T04:16:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13632024-10-19T04:16:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13642024-10-19T04:16:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13652024-10-19T04:16:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13662024-10-19T04:16:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
13672024-10-19T04:16:14.860ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("077283a3-2f69-419e-8ab2-1088c51300c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f0b5b4d-c580-4418-9bbc-5d1b6d257b94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a79265b8-3f31-40c4-bdbb-3f2463bd3c30.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a79265b8-3f31-40c4-bdbb-3f2463bd3c30.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 8740, tv_nsec: 969470539 } })
13682024-10-19T04:16:14.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13692024-10-19T04:16:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13702024-10-19T04:16:14.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13712024-10-19T04:16:14.861ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3881ebd6-060e-4a3f-8035-5fd76566e5d0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4ba9b73a-0f82-489d-a9fb-902be604440b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("4ba9b73a-0f82-489d-a9fb-902be604440b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 8740, tv_nsec: 970318376 } })
13722024-10-19T04:16:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13732024-10-19T04:16:14.862ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
13742024-10-19T04:16:14.862ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.689653ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
13752024-10-19T04:16:14.862ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-19 04:06:14.859372112 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
13762024-10-19T04:16:14.862ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.855796ms iteration = 8 status = {"expiration":"2024-10-19T04:06:14.859372112Z","pruned":[]}
13772024-10-19T04:16:14.862ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.464658ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
13782024-10-19T04:16:14.862ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
13792024-10-19T04:16:14.862ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.317786ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
13802024-10-19T04:16:14.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13812024-10-19T04:16:14.863ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.670353ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
13822024-10-19T04:16:14.863ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13832024-10-19T04:16:14.863ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13842024-10-19T04:16:14.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13852024-10-19T04:16:14.864ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13862024-10-19T04:16:14.864ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8740, tv_nsec: 974020219 } })
13872024-10-19T04:16:14.864ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13882024-10-19T04:16:14.864ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13892024-10-19T04:16:14.865ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
13902024-10-19T04:16:14.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13912024-10-19T04:16:14.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13922024-10-19T04:16:14.866ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13932024-10-19T04:16:14.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.849805ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
13942024-10-19T04:16:14.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13952024-10-19T04:16:14.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
13962024-10-19T04:16:14.866ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
13972024-10-19T04:16:14.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
13982024-10-19T04:16:14.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
13992024-10-19T04:16:14.866ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14002024-10-19T04:16:14.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14012024-10-19T04:16:14.867ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14022024-10-19T04:16:14.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14032024-10-19T04:16:14.867ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8740, tv_nsec: 976751513 } })
14042024-10-19T04:16:14.867ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14052024-10-19T04:16:14.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14062024-10-19T04:16:14.867ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
14072024-10-19T04:16:14.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14082024-10-19T04:16:14.868ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14092024-10-19T04:16:14.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14102024-10-19T04:16:14.868ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14112024-10-19T04:16:14.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14122024-10-19T04:16:14.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14132024-10-19T04:16:14.868ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14142024-10-19T04:16:14.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14152024-10-19T04:16:14.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14162024-10-19T04:16:14.869ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14172024-10-19T04:16:14.869ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
14182024-10-19T04:16:14.869ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
14192024-10-19T04:16:14.869ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 9.826023ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
14202024-10-19T04:16:14.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14212024-10-19T04:16:14.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14222024-10-19T04:16:14.869ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
14232024-10-19T04:16:14.869ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
14242024-10-19T04:16:14.869ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 9.941136ms iteration = 8 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
14252024-10-19T04:16:14.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14262024-10-19T04:16:14.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 10.586619ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14272024-10-19T04:16:14.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14282024-10-19T04:16:14.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14292024-10-19T04:16:14.871ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14302024-10-19T04:16:14.871ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8740, tv_nsec: 980387474 } })
14312024-10-19T04:16:14.871ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14322024-10-19T04:16:14.871ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14332024-10-19T04:16:14.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14342024-10-19T04:16:14.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14352024-10-19T04:16:14.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14362024-10-19T04:16:14.872ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
14372024-10-19T04:16:14.872ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
14382024-10-19T04:16:14.872ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
14392024-10-19T04:16:14.872ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
14402024-10-19T04:16:14.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14412024-10-19T04:16:14.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14422024-10-19T04:16:14.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14432024-10-19T04:16:14.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14442024-10-19T04:16:14.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14452024-10-19T04:16:14.874ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
14462024-10-19T04:16:14.874ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14472024-10-19T04:16:14.874ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14482024-10-19T04:16:14.874ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14492024-10-19T04:16:14.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14502024-10-19T04:16:14.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14512024-10-19T04:16:14.874ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 15.063476ms iteration = 15 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
14522024-10-19T04:16:14.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14532024-10-19T04:16:14.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14542024-10-19T04:16:14.874ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14552024-10-19T04:16:14.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14562024-10-19T04:16:14.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14572024-10-19T04:16:14.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14582024-10-19T04:16:14.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14592024-10-19T04:16:14.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14602024-10-19T04:16:14.875ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14612024-10-19T04:16:14.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14622024-10-19T04:16:14.875ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
14632024-10-19T04:16:14.875ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14642024-10-19T04:16:14.875ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 16.102017ms iteration = 15 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
14652024-10-19T04:16:14.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
14662024-10-19T04:16:14.876ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14672024-10-19T04:16:14.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14682024-10-19T04:16:14.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14692024-10-19T04:16:14.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14702024-10-19T04:16:14.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14712024-10-19T04:16:14.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14722024-10-19T04:16:14.877ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14732024-10-19T04:16:14.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14742024-10-19T04:16:14.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14752024-10-19T04:16:14.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14762024-10-19T04:16:14.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14772024-10-19T04:16:14.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14782024-10-19T04:16:14.878ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
14792024-10-19T04:16:14.878ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
14802024-10-19T04:16:14.878ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
14812024-10-19T04:16:14.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14822024-10-19T04:16:14.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14832024-10-19T04:16:14.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14842024-10-19T04:16:14.878ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14852024-10-19T04:16:14.879ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
14862024-10-19T04:16:14.879ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = fb44ee4c-c5ec-4992-abdf-b6f7e2fadda5 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
14872024-10-19T04:16:14.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14882024-10-19T04:16:14.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14892024-10-19T04:16:14.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14902024-10-19T04:16:14.881ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14912024-10-19T04:16:14.881ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14922024-10-19T04:16:14.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14932024-10-19T04:16:14.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14942024-10-19T04:16:14.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
14952024-10-19T04:16:14.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14962024-10-19T04:16:14.881ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14972024-10-19T04:16:14.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14982024-10-19T04:16:14.881ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 22.241428ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
14992024-10-19T04:16:14.882ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 22.981813ms iteration = 18 status = {"physical_disks_added":0}
15002024-10-19T04:16:14.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15012024-10-19T04:16:14.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15022024-10-19T04:16:14.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15032024-10-19T04:16:14.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15042024-10-19T04:16:14.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15052024-10-19T04:16:14.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15062024-10-19T04:16:14.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15072024-10-19T04:16:14.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15082024-10-19T04:16:14.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15092024-10-19T04:16:14.885ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
15102024-10-19T04:16:14.885ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a4077ac0-652e-4998-9c99-e66a22abccb6 dns_zone_name = oxide.test found_so_far = 0 version = 2
15112024-10-19T04:16:14.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15122024-10-19T04:16:14.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15132024-10-19T04:16:14.886ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15142024-10-19T04:16:14.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15152024-10-19T04:16:14.886ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = fb44ee4c-c5ec-4992-abdf-b6f7e2fadda5 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
15162024-10-19T04:16:14.886ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
15172024-10-19T04:16:14.886ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-19 04:10:05.441343 UTC dns_group = internal generation = 1
15182024-10-19T04:16:14.886ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 27.439041ms iteration = 9 status = {"generation":1}
15192024-10-19T04:16:14.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15202024-10-19T04:16:14.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15212024-10-19T04:16:14.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15222024-10-19T04:16:14.888ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
15232024-10-19T04:16:14.888ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.503721ms iteration = 43 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
15242024-10-19T04:16:14.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15252024-10-19T04:16:14.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15262024-10-19T04:16:14.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15272024-10-19T04:16:14.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15282024-10-19T04:16:14.889ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15292024-10-19T04:16:14.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15302024-10-19T04:16:14.891ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a4077ac0-652e-4998-9c99-e66a22abccb6 dns_zone_name = oxide.test found_so_far = 1 version = 2
15312024-10-19T04:16:14.891ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
15322024-10-19T04:16:14.891ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-19 04:10:05.874167 UTC dns_group = external generation = 2
15332024-10-19T04:16:14.891ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 31.819567ms iteration = 9 status = {"generation":2}
15342024-10-19T04:16:14.894ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15352024-10-19T04:16:14.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15362024-10-19T04:16:14.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15372024-10-19T04:16:14.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15382024-10-19T04:16:14.896ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 36.713294ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
15392024-10-19T04:16:14.896ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-19T04:09:14.003740Z, time_modified: 2024-10-19T04:09:14.003740Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, db_silo: Silo { identity: SiloIdentity { id: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-19T04:10:05.838166Z, time_modified: 2024-10-19T04:10:05.838166Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1f4033bd55b23e094b1263660016971c2c68cc6162a83dcd709c701bd968e3c5" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, db_silo: Silo { identity: SiloIdentity { id: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-19T04:10:05.838166Z, time_modified: 2024-10-19T04:10:05.838166Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1f4033bd55b23e094b1263660016971c2c68cc6162a83dcd709c701bd968e3c5" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
15402024-10-19T04:16:14.896ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 37.153832ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"54ab3538-1bb1-4d5e-a518-5d0dec26f2d7","tls_certs":["1f4033bd55b23e094b1263660016971c2c68cc6162a83dcd709c701bd968e3c5"]}},"default_endpoint":{"silo_id":"54ab3538-1bb1-4d5e-a518-5d0dec26f2d7","tls_certs":["1f4033bd55b23e094b1263660016971c2c68cc6162a83dcd709c701bd968e3c5"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
15412024-10-19T04:16:14.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15422024-10-19T04:16:14.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8180ea00-0a5e-4377-b19a-82e7e60b09bd, lookup_type: ById(8180ea00-0a5e-4377-b19a-82e7e60b09bd) } result = Ok(())
15432024-10-19T04:16:14.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15442024-10-19T04:16:14.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15452024-10-19T04:16:14.900ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 41.10778ms iteration = 15 status = 0
15462024-10-19T04:16:15.035ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
15472024-10-19T04:16:15.048ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
15482024-10-19T04:16:15.064ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15492024-10-19T04:16:15.064ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9ff21a1d-2f92-422a-b0d2-fed434be1756", "content-length": "372", "date": "Sat, 19 Oct 2024 04:16:15 GMT"} })
15502024-10-19T04:16:15.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15512024-10-19T04:16:15.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15522024-10-19T04:16:15.074ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15532024-10-19T04:16:15.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15542024-10-19T04:16:15.079ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15552024-10-19T04:16:15.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15562024-10-19T04:16:15.081ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15572024-10-19T04:16:15.082ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "96132bfc-8aea-44b1-b94a-579c8b9230a3", "date": "Sat, 19 Oct 2024 04:16:15 GMT"} })
15582024-10-19T04:16:15.083ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 224.409041ms iteration = 17 status = {}
15592024-10-19T04:16:15.085ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 zone_address = fd00:1122:3344:101::2
15602024-10-19T04:16:15.086ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15612024-10-19T04:16:15.086ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7c4f280a-8924-4b20-9e94-a20d77768948", "content-length": "26", "date": "Sat, 19 Oct 2024 04:16:15 GMT"} })
15622024-10-19T04:16:15.086ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15632024-10-19T04:16:15.089ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
15642024-10-19T04:16:15.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e996216c-8ebf-4ac4-baf1-90ae6c80dbf9 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
15652024-10-19T04:16:15.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e996216c-8ebf-4ac4-baf1-90ae6c80dbf9 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
15662024-10-19T04:16:15.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2674 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e996216c-8ebf-4ac4-baf1-90ae6c80dbf9 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
15672024-10-19T04:16:15.108ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
15682024-10-19T04:16:15.108ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a49eb5b8-0ea7-4e23-8c93-6382c3707469", "content-length": "691", "date": "Sat, 19 Oct 2024 04:16:15 GMT"} })
15692024-10-19T04:16:15.108ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
15702024-10-19T04:16:15.108ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
15712024-10-19T04:16:15.108ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
15722024-10-19T04:16:15.110ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 251.26376ms iteration = 16 status = {}
15732024-10-19T04:16:15.174ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
15742024-10-19T04:16:15.174ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15752024-10-19T04:16:15.175ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f58977af-cef3-4cbc-ac88-04c52263872b", "content-length": "26", "date": "Sat, 19 Oct 2024 04:16:15 GMT"} })
15762024-10-19T04:16:15.175ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15772024-10-19T04:16:15.177ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15782024-10-19T04:16:15.179ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
15792024-10-19T04:16:15.191ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
15802024-10-19T04:16:15.191ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15812024-10-19T04:16:15.193ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "430955cd-a1ec-44e4-b0cd-d8bcc6d90b84", "content-length": "26", "date": "Sat, 19 Oct 2024 04:16:15 GMT"} })
15822024-10-19T04:16:15.193ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15832024-10-19T04:16:15.194ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15842024-10-19T04:16:15.203ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
15852024-10-19T04:16:15.203ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9e8f1050-af60-4294-8709-b8d6aae950fa", "date": "Sat, 19 Oct 2024 04:16:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15862024-10-19T04:16:15.203ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15872024-10-19T04:16:15.204ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "66a2a5ae-348e-4899-adce-2dbc253d0114", "date": "Sat, 19 Oct 2024 04:16:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15882024-10-19T04:16:15.204ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15892024-10-19T04:16:15.206ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15902024-10-19T04:16:15.206ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 346.802631ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
15912024-10-19T04:16:15.289ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
15922024-10-19T04:16:15.289ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "305f2870-befb-4cb2-af3e-c03c5456c3e8", "date": "Sat, 19 Oct 2024 04:16:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15932024-10-19T04:16:15.289ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15942024-10-19T04:16:15.291ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2feb0b3c-2ae6-4a3b-ae1b-5efce02fa96b", "date": "Sat, 19 Oct 2024 04:16:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15952024-10-19T04:16:15.291ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15962024-10-19T04:16:15.293ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "03d0d653-c58d-4def-a25b-9188e5f986b7", "date": "Sat, 19 Oct 2024 04:16:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15972024-10-19T04:16:15.293ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15982024-10-19T04:16:15.294ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 434.675512ms iteration = 15 status = {}
15992024-10-19T04:16:15.295ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16002024-10-19T04:16:15.295ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 435.986089ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
16012024-10-19T04:16:15.301ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16022024-10-19T04:16:15.301ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "26da6061-7063-4424-bd47-c935199ca8ac", "content-length": "2", "date": "Sat, 19 Oct 2024 04:16:14 GMT"} })
16032024-10-19T04:16:15.302ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16042024-10-19T04:16:15.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16052024-10-19T04:16:15.304ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 445.063877ms iteration = 15 status = null
16062024-10-19T04:16:15.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16072024-10-19T04:16:15.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16082024-10-19T04:16:15.348ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 67c66fb2-5b53-4f7b-be0b-63b92427bb54, rack_id: 7a4ab4db-4586-4060-be07-8fb242636fc1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ce7dad06-a40f-46ae-96ea-31487ccc19ce) } rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0
16092024-10-19T04:16:15.348ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16102024-10-19T04:16:15.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16112024-10-19T04:16:15.355ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16122024-10-19T04:16:15.355ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bd5297f8-b9ed-4343-8ff6-fa07444ba8b7", "content-length": "121", "date": "Sat, 19 Oct 2024 04:16:14 GMT"} })
16132024-10-19T04:16:15.355ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
16142024-10-19T04:16:15.355ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ce7dad06-a40f-46ae-96ea-31487ccc19ce
16152024-10-19T04:16:15.356ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16162024-10-19T04:16:15.356ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16172024-10-19T04:16:15.356ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {}
16182024-10-19T04:16:15.356ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {}
16192024-10-19T04:16:15.356ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
16202024-10-19T04:16:15.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16212024-10-19T04:16:15.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16222024-10-19T04:16:15.358ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
16232024-10-19T04:16:15.358ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "18cd67e5-2f43-4c32-8237-c507dfd39f89", "content-length": "2", "date": "Sat, 19 Oct 2024 04:16:14 GMT"} })
16242024-10-19T04:16:15.358ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16252024-10-19T04:16:15.359ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "957fc4ff-ce78-4456-9b8c-3443b1b7a5e7", "content-length": "52", "date": "Sat, 19 Oct 2024 04:16:14 GMT"} })
16262024-10-19T04:16:15.359ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0
16272024-10-19T04:16:15.359ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16282024-10-19T04:16:15.458ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "87fd8cc5-68c5-4483-8d04-76e9a513a7c4", "date": "Sat, 19 Oct 2024 04:16:15 GMT"} })
16292024-10-19T04:16:15.458ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch = Switch0
16302024-10-19T04:16:15.458ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16312024-10-19T04:16:15.459ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8bb17e8d-4077-42fc-8f96-36474710d821", "content-length": "667", "date": "Sat, 19 Oct 2024 04:16:15 GMT"} })
16322024-10-19T04:16:15.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16332024-10-19T04:16:15.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16342024-10-19T04:16:15.463ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16352024-10-19T04:16:15.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16362024-10-19T04:16:15.466ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16372024-10-19T04:16:15.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16382024-10-19T04:16:15.467ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16392024-10-19T04:16:15.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16402024-10-19T04:16:15.474ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 614.931253ms iteration = 15 status = {}
16412024-10-19T04:16:16.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 281e591b-e99e-44a2-9d0f-7f117c8037a8 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16422024-10-19T04:16:16.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 281e591b-e99e-44a2-9d0f-7f117c8037a8 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16432024-10-19T04:16:16.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2705 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 281e591b-e99e-44a2-9d0f-7f117c8037a8 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16442024-10-19T04:16:16.901ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1528 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = 55b6cba0-3efe-48af-b16d-6ac71972c071 response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
16452024-10-19T04:16:17.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2733c82a-b60c-4202-8a70-82078f08c461 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16462024-10-19T04:16:17.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2733c82a-b60c-4202-8a70-82078f08c461 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16472024-10-19T04:16:17.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2589 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2733c82a-b60c-4202-8a70-82078f08c461 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16482024-10-19T04:16:18.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 8c137ab6-8f6c-4f2e-b42c-d8e4c0a55aa2 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16492024-10-19T04:16:18.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 8c137ab6-8f6c-4f2e-b42c-d8e4c0a55aa2 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16502024-10-19T04:16:18.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2763 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 8c137ab6-8f6c-4f2e-b42c-d8e4c0a55aa2 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16512024-10-19T04:16:19.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f7cfa61f-a127-4ed9-a85d-70c374c58eed roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16522024-10-19T04:16:19.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f7cfa61f-a127-4ed9-a85d-70c374c58eed resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16532024-10-19T04:16:19.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f7cfa61f-a127-4ed9-a85d-70c374c58eed response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16542024-10-19T04:16:20.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f33a70a9-31dd-418f-bf60-e36753d0a73d roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16552024-10-19T04:16:20.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f33a70a9-31dd-418f-bf60-e36753d0a73d resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16562024-10-19T04:16:20.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f33a70a9-31dd-418f-bf60-e36753d0a73d response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16572024-10-19T04:16:21.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 595738be-8e82-4a94-a06f-787df2412bb4 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16582024-10-19T04:16:21.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 595738be-8e82-4a94-a06f-787df2412bb4 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16592024-10-19T04:16:21.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2259 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 595738be-8e82-4a94-a06f-787df2412bb4 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16602024-10-19T04:16:22.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 85ed63f4-014f-461d-aad4-80413552b459 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16612024-10-19T04:16:22.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 85ed63f4-014f-461d-aad4-80413552b459 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16622024-10-19T04:16:22.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2556 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 85ed63f4-014f-461d-aad4-80413552b459 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16632024-10-19T04:16:23.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 39dc093d-5a5d-49ce-899a-dc3ffb6d93b5 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16642024-10-19T04:16:23.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 39dc093d-5a5d-49ce-899a-dc3ffb6d93b5 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16652024-10-19T04:16:23.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 39dc093d-5a5d-49ce-899a-dc3ffb6d93b5 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16662024-10-19T04:16:24.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0a6ce90e-5da4-4fe2-9163-b5addd3a3e03 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16672024-10-19T04:16:24.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0a6ce90e-5da4-4fe2-9163-b5addd3a3e03 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16682024-10-19T04:16:24.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1952 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0a6ce90e-5da4-4fe2-9163-b5addd3a3e03 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16692024-10-19T04:16:24.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
16702024-10-19T04:16:24.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16712024-10-19T04:16:24.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
16722024-10-19T04:16:24.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16732024-10-19T04:16:24.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16742024-10-19T04:16:24.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16752024-10-19T04:16:24.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16762024-10-19T04:16:24.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16772024-10-19T04:16:24.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16782024-10-19T04:16:24.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.806575ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16792024-10-19T04:16:24.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16802024-10-19T04:16:24.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16812024-10-19T04:16:24.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16822024-10-19T04:16:24.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16832024-10-19T04:16:24.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16842024-10-19T04:16:24.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16852024-10-19T04:16:24.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
16862024-10-19T04:16:24.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16872024-10-19T04:16:24.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16882024-10-19T04:16:24.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
16892024-10-19T04:16:24.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.153279ms iteration = 44 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
16902024-10-19T04:16:25.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0b64c8a3-9d5a-48ab-9509-af7597d73549 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16912024-10-19T04:16:25.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0b64c8a3-9d5a-48ab-9509-af7597d73549 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16922024-10-19T04:16:25.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1671 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0b64c8a3-9d5a-48ab-9509-af7597d73549 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16932024-10-19T04:16:26.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 23fd3793-ef23-4b75-80c6-8a20760e0a05 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16942024-10-19T04:16:26.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 23fd3793-ef23-4b75-80c6-8a20760e0a05 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16952024-10-19T04:16:26.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2179 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 23fd3793-ef23-4b75-80c6-8a20760e0a05 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
16962024-10-19T04:16:26.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = af6b3dbc-c017-4689-8869-91d6b993f805 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
16972024-10-19T04:16:26.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = af6b3dbc-c017-4689-8869-91d6b993f805 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
16982024-10-19T04:16:26.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = af6b3dbc-c017-4689-8869-91d6b993f805 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
16992024-10-19T04:16:26.900ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1450 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = fb40200d-fc2b-40ad-8b42-51b428614adf response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
17002024-10-19T04:16:27.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 06250a2b-8d08-43b9-b2fd-0689c85dfec9 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17012024-10-19T04:16:27.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 06250a2b-8d08-43b9-b2fd-0689c85dfec9 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17022024-10-19T04:16:27.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 06250a2b-8d08-43b9-b2fd-0689c85dfec9 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17032024-10-19T04:16:28.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 46695397-fc91-49c7-bdfd-1b0eeb7d21ae roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17042024-10-19T04:16:28.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 46695397-fc91-49c7-bdfd-1b0eeb7d21ae resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17052024-10-19T04:16:28.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 46695397-fc91-49c7-bdfd-1b0eeb7d21ae response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17062024-10-19T04:16:29.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e7631d65-700f-4a9f-9ee5-026255e9ce55 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17072024-10-19T04:16:29.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e7631d65-700f-4a9f-9ee5-026255e9ce55 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17082024-10-19T04:16:29.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e7631d65-700f-4a9f-9ee5-026255e9ce55 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17092024-10-19T04:16:30.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 87fa9619-756a-4873-82c9-7bc739a45276 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17102024-10-19T04:16:30.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 87fa9619-756a-4873-82c9-7bc739a45276 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17112024-10-19T04:16:30.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2590 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 87fa9619-756a-4873-82c9-7bc739a45276 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17122024-10-19T04:16:31.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 067fe759-9301-4b74-bf83-fc541158089c roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17132024-10-19T04:16:31.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 067fe759-9301-4b74-bf83-fc541158089c resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17142024-10-19T04:16:31.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2025 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 067fe759-9301-4b74-bf83-fc541158089c response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17152024-10-19T04:16:32.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7c3c0c53-5bd1-41eb-b6e5-9843a95f29f6 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17162024-10-19T04:16:32.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7c3c0c53-5bd1-41eb-b6e5-9843a95f29f6 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17172024-10-19T04:16:32.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3792 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7c3c0c53-5bd1-41eb-b6e5-9843a95f29f6 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17182024-10-19T04:16:33.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1dcb2611-4b2f-43c7-adaa-21f3601c8572 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17192024-10-19T04:16:33.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1dcb2611-4b2f-43c7-adaa-21f3601c8572 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17202024-10-19T04:16:33.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1dcb2611-4b2f-43c7-adaa-21f3601c8572 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17212024-10-19T04:16:34.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 68db4275-4e69-4891-a726-8a61094f9187 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17222024-10-19T04:16:34.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 68db4275-4e69-4891-a726-8a61094f9187 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17232024-10-19T04:16:34.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 68db4275-4e69-4891-a726-8a61094f9187 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17242024-10-19T04:16:34.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
17252024-10-19T04:16:34.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
17262024-10-19T04:16:34.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17272024-10-19T04:16:34.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17282024-10-19T04:16:34.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17292024-10-19T04:16:34.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17302024-10-19T04:16:34.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17312024-10-19T04:16:34.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17322024-10-19T04:16:34.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17332024-10-19T04:16:34.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.0461ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17342024-10-19T04:16:34.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17352024-10-19T04:16:34.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17362024-10-19T04:16:34.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17372024-10-19T04:16:34.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17382024-10-19T04:16:34.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17392024-10-19T04:16:34.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17402024-10-19T04:16:34.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
17412024-10-19T04:16:34.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17422024-10-19T04:16:34.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17432024-10-19T04:16:34.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
17442024-10-19T04:16:34.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.24563ms iteration = 45 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
17452024-10-19T04:16:35.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0443df10-3699-4b85-a821-3260ee5b6f9d roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17462024-10-19T04:16:35.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0443df10-3699-4b85-a821-3260ee5b6f9d resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17472024-10-19T04:16:35.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0443df10-3699-4b85-a821-3260ee5b6f9d response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17482024-10-19T04:16:36.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = aeef7f5a-9c8e-4c75-9cce-79b6324b0c1a roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17492024-10-19T04:16:36.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = aeef7f5a-9c8e-4c75-9cce-79b6324b0c1a resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17502024-10-19T04:16:36.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = aeef7f5a-9c8e-4c75-9cce-79b6324b0c1a response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17512024-10-19T04:16:36.902ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2470 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = 228d95c2-0d9e-47ff-8666-7305b42eb10a response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
17522024-10-19T04:16:37.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0288618b-5b81-49be-ad43-c66360bc91dd roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17532024-10-19T04:16:37.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0288618b-5b81-49be-ad43-c66360bc91dd resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17542024-10-19T04:16:37.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0288618b-5b81-49be-ad43-c66360bc91dd response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17552024-10-19T04:16:38.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e04bc1b9-ecb8-48f3-8b3d-c08a468f656d roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17562024-10-19T04:16:38.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e04bc1b9-ecb8-48f3-8b3d-c08a468f656d resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17572024-10-19T04:16:38.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3301 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e04bc1b9-ecb8-48f3-8b3d-c08a468f656d response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17582024-10-19T04:16:39.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a3dd3e1-f6e3-41bf-a901-e9aae5afe94d roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17592024-10-19T04:16:39.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a3dd3e1-f6e3-41bf-a901-e9aae5afe94d resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17602024-10-19T04:16:39.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a3dd3e1-f6e3-41bf-a901-e9aae5afe94d response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17612024-10-19T04:16:40.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ee502e04-4693-4999-9838-70c9599d3a5e roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17622024-10-19T04:16:40.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ee502e04-4693-4999-9838-70c9599d3a5e resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17632024-10-19T04:16:40.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ee502e04-4693-4999-9838-70c9599d3a5e response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17642024-10-19T04:16:41.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = fece555d-9055-4b13-90ee-9982987b8b6c roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17652024-10-19T04:16:41.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = fece555d-9055-4b13-90ee-9982987b8b6c resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17662024-10-19T04:16:41.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = fece555d-9055-4b13-90ee-9982987b8b6c response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17672024-10-19T04:16:42.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4a518f1d-242b-40c1-b0a3-a1b4df06066a roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17682024-10-19T04:16:42.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4a518f1d-242b-40c1-b0a3-a1b4df06066a resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17692024-10-19T04:16:42.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4a518f1d-242b-40c1-b0a3-a1b4df06066a response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17702024-10-19T04:16:43.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 8e61b488-76ef-4408-b873-33d96eb64d98 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17712024-10-19T04:16:43.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 8e61b488-76ef-4408-b873-33d96eb64d98 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17722024-10-19T04:16:43.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2488 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 8e61b488-76ef-4408-b873-33d96eb64d98 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17732024-10-19T04:16:44.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = c9149406-9eca-4043-ade3-b5c77ee6361a roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17742024-10-19T04:16:44.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = c9149406-9eca-4043-ade3-b5c77ee6361a resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17752024-10-19T04:16:44.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = c9149406-9eca-4043-ade3-b5c77ee6361a response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
17762024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
17772024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
17782024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17792024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17802024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
17812024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
17822024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17832024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17842024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
17852024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
17862024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17872024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
17882024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
17892024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17902024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
17912024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
17922024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17932024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17942024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
17952024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17962024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17972024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
17982024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
17992024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18002024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18012024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
18022024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
18032024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18042024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
18052024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18062024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18072024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18082024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18092024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
18102024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18112024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18122024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18132024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18142024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18152024-10-19T04:16:44.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18162024-10-19T04:16:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18172024-10-19T04:16:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18182024-10-19T04:16:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18192024-10-19T04:16:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18202024-10-19T04:16:44.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18212024-10-19T04:16:44.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18222024-10-19T04:16:44.861ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
18232024-10-19T04:16:44.861ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18242024-10-19T04:16:44.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18252024-10-19T04:16:44.861ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18262024-10-19T04:16:44.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18272024-10-19T04:16:44.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.881296ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
18282024-10-19T04:16:44.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18292024-10-19T04:16:44.862ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.883377ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18302024-10-19T04:16:44.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.332866ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18312024-10-19T04:16:44.863ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8770, tv_nsec: 972388786 } })
18322024-10-19T04:16:44.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18332024-10-19T04:16:44.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18342024-10-19T04:16:44.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18352024-10-19T04:16:44.863ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8770, tv_nsec: 973156052 } })
18362024-10-19T04:16:44.864ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
18372024-10-19T04:16:44.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18382024-10-19T04:16:44.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18392024-10-19T04:16:44.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18402024-10-19T04:16:44.864ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18412024-10-19T04:16:44.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18422024-10-19T04:16:44.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18432024-10-19T04:16:44.864ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18442024-10-19T04:16:44.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18452024-10-19T04:16:44.864ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
18462024-10-19T04:16:44.864ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
18472024-10-19T04:16:44.864ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 5.486438ms iteration = 16 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
18482024-10-19T04:16:44.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18492024-10-19T04:16:44.865ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
18502024-10-19T04:16:44.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 6.09837ms iteration = 16 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
18512024-10-19T04:16:44.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18522024-10-19T04:16:44.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18532024-10-19T04:16:44.866ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8770, tv_nsec: 975940356 } })
18542024-10-19T04:16:44.867ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18552024-10-19T04:16:44.867ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18562024-10-19T04:16:44.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18572024-10-19T04:16:44.867ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
18582024-10-19T04:16:44.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18592024-10-19T04:16:44.867ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18602024-10-19T04:16:44.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18612024-10-19T04:16:44.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18622024-10-19T04:16:44.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18632024-10-19T04:16:44.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18642024-10-19T04:16:44.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18652024-10-19T04:16:44.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18662024-10-19T04:16:44.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18672024-10-19T04:16:44.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.132129ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
18682024-10-19T04:16:44.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18692024-10-19T04:16:44.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18702024-10-19T04:16:44.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18712024-10-19T04:16:44.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18722024-10-19T04:16:44.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18732024-10-19T04:16:44.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18742024-10-19T04:16:44.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18752024-10-19T04:16:44.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18762024-10-19T04:16:44.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18772024-10-19T04:16:44.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18782024-10-19T04:16:44.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18792024-10-19T04:16:44.871ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18802024-10-19T04:16:44.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18812024-10-19T04:16:44.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18822024-10-19T04:16:44.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18832024-10-19T04:16:44.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
18842024-10-19T04:16:44.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18852024-10-19T04:16:44.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18862024-10-19T04:16:44.875ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
18872024-10-19T04:16:44.875ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 16.109968ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
18882024-10-19T04:16:44.875ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18892024-10-19T04:16:44.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18902024-10-19T04:16:44.876ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 17.22444ms iteration = 19 status = {"physical_disks_added":0}
18912024-10-19T04:16:44.879ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
18922024-10-19T04:16:44.879ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.123737ms iteration = 46 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
18932024-10-19T04:16:44.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18942024-10-19T04:16:44.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18952024-10-19T04:16:44.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18962024-10-19T04:16:44.885ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18972024-10-19T04:16:44.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18982024-10-19T04:16:44.885ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18992024-10-19T04:16:44.885ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19002024-10-19T04:16:44.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19012024-10-19T04:16:44.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19022024-10-19T04:16:44.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19032024-10-19T04:16:44.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19042024-10-19T04:16:44.888ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19052024-10-19T04:16:44.888ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19062024-10-19T04:16:44.888ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19072024-10-19T04:16:44.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19082024-10-19T04:16:44.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8180ea00-0a5e-4377-b19a-82e7e60b09bd, lookup_type: ById(8180ea00-0a5e-4377-b19a-82e7e60b09bd) } result = Ok(())
19092024-10-19T04:16:44.891ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19102024-10-19T04:16:44.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19112024-10-19T04:16:44.892ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 33.51346ms iteration = 16 status = 0
19122024-10-19T04:16:45.000ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
19132024-10-19T04:16:45.000ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19142024-10-19T04:16:45.000ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fc22d969-d26c-4ea8-be1b-050a49ff7e08", "content-length": "26", "date": "Sat, 19 Oct 2024 04:16:45 GMT"} })
19152024-10-19T04:16:45.000ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19162024-10-19T04:16:45.002ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19172024-10-19T04:16:45.010ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19182024-10-19T04:16:45.011ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2ba2fb30-e791-45ae-a0f9-407e45934932", "content-length": "372", "date": "Sat, 19 Oct 2024 04:16:45 GMT"} })
19192024-10-19T04:16:45.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19202024-10-19T04:16:45.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19212024-10-19T04:16:45.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19222024-10-19T04:16:45.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19232024-10-19T04:16:45.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19242024-10-19T04:16:45.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19252024-10-19T04:16:45.017ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19262024-10-19T04:16:45.018ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5c943c81-6e85-4b43-9cf4-faff0771e9c8", "date": "Sat, 19 Oct 2024 04:16:45 GMT"} })
19272024-10-19T04:16:45.020ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 160.96082ms iteration = 18 status = {}
19282024-10-19T04:16:45.040ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
19292024-10-19T04:16:45.040ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4089c81a-1ccd-4839-83b0-7cfe2d4b04c4", "content-length": "691", "date": "Sat, 19 Oct 2024 04:16:45 GMT"} })
19302024-10-19T04:16:45.040ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
19312024-10-19T04:16:45.040ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
19322024-10-19T04:16:45.040ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
19332024-10-19T04:16:45.041ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 182.425293ms iteration = 17 status = {}
19342024-10-19T04:16:45.154ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
19352024-10-19T04:16:45.154ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19362024-10-19T04:16:45.156ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "74916bd8-dd80-4419-8768-9ffa82fc2f56", "content-length": "26", "date": "Sat, 19 Oct 2024 04:16:45 GMT"} })
19372024-10-19T04:16:45.156ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19382024-10-19T04:16:45.158ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 zone_address = fd00:1122:3344:101::2
19392024-10-19T04:16:45.158ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19402024-10-19T04:16:45.159ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19412024-10-19T04:16:45.159ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "32fc0e9c-6eec-4881-8ff9-fe524a8168b7", "content-length": "26", "date": "Sat, 19 Oct 2024 04:16:45 GMT"} })
19422024-10-19T04:16:45.159ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19432024-10-19T04:16:45.161ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
19442024-10-19T04:16:45.201ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19452024-10-19T04:16:45.203ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f3efef78-4812-4679-a3d4-4dbf6180d37e", "content-length": "2", "date": "Sat, 19 Oct 2024 04:16:44 GMT"} })
19462024-10-19T04:16:45.205ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19472024-10-19T04:16:45.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19482024-10-19T04:16:45.206ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 347.433293ms iteration = 16 status = null
19492024-10-19T04:16:45.237ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 378.374793ms iteration = 16 status = {}
19502024-10-19T04:16:45.293ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19512024-10-19T04:16:45.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19522024-10-19T04:16:45.296ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 67c66fb2-5b53-4f7b-be0b-63b92427bb54, rack_id: 7a4ab4db-4586-4060-be07-8fb242636fc1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ce7dad06-a40f-46ae-96ea-31487ccc19ce) } rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0
19532024-10-19T04:16:45.296ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19542024-10-19T04:16:45.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19552024-10-19T04:16:45.302ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
19562024-10-19T04:16:45.303ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f4a9a1e5-ca68-4a83-91ee-f81d152b95bb", "content-length": "121", "date": "Sat, 19 Oct 2024 04:16:44 GMT"} })
19572024-10-19T04:16:45.303ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
19582024-10-19T04:16:45.303ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ce7dad06-a40f-46ae-96ea-31487ccc19ce
19592024-10-19T04:16:45.303ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
19602024-10-19T04:16:45.303ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
19612024-10-19T04:16:45.303ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {}
19622024-10-19T04:16:45.303ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {}
19632024-10-19T04:16:45.303ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
19642024-10-19T04:16:45.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19652024-10-19T04:16:45.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19662024-10-19T04:16:45.305ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
19672024-10-19T04:16:45.305ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f88aab04-c105-484e-bfb7-5e1fd9117480", "content-length": "2", "date": "Sat, 19 Oct 2024 04:16:44 GMT"} })
19682024-10-19T04:16:45.305ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
19692024-10-19T04:16:45.305ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "09e3404e-17bf-4ada-a1c8-b15970310938", "content-length": "52", "date": "Sat, 19 Oct 2024 04:16:44 GMT"} })
19702024-10-19T04:16:45.305ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0
19712024-10-19T04:16:45.305ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
19722024-10-19T04:16:45.395ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "71732b0f-30d9-438a-b216-068d10611b79", "date": "Sat, 19 Oct 2024 04:16:45 GMT"} })
19732024-10-19T04:16:45.395ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch = Switch0
19742024-10-19T04:16:45.395ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
19752024-10-19T04:16:45.395ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e852e569-0da3-44d1-bb1a-db0bb957bcb9", "content-length": "667", "date": "Sat, 19 Oct 2024 04:16:45 GMT"} })
19762024-10-19T04:16:45.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19772024-10-19T04:16:45.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19782024-10-19T04:16:45.399ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19792024-10-19T04:16:45.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19802024-10-19T04:16:45.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19812024-10-19T04:16:45.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19822024-10-19T04:16:45.404ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19832024-10-19T04:16:45.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19842024-10-19T04:16:45.410ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 551.648207ms iteration = 16 status = {}
19852024-10-19T04:16:45.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a622d49-d0ef-4add-ad03-6f9f5054e4f0 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
19862024-10-19T04:16:45.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a622d49-d0ef-4add-ad03-6f9f5054e4f0 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
19872024-10-19T04:16:45.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2a622d49-d0ef-4add-ad03-6f9f5054e4f0 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
19882024-10-19T04:16:46.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7a594337-37b2-40b7-bbe2-ed4122c959da roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
19892024-10-19T04:16:46.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7a594337-37b2-40b7-bbe2-ed4122c959da resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
19902024-10-19T04:16:46.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7a594337-37b2-40b7-bbe2-ed4122c959da response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
19912024-10-19T04:16:46.900ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2007 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = b80b4af7-e727-4b78-83bc-5ed3cd960ae3 response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
19922024-10-19T04:16:47.791ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:51498
19932024-10-19T04:16:47.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d71b78dd-123e-4119-b866-0644b929842e roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
19942024-10-19T04:16:47.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d71b78dd-123e-4119-b866-0644b929842e resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
19952024-10-19T04:16:47.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51498 req_id = 644f217a-0fdf-458f-8221-f688957138a0 roles = RoleSet { roles: {} } uri = /metrics/producers
19962024-10-19T04:16:47.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51498 req_id = 644f217a-0fdf-458f-8221-f688957138a0 resource = Database result = Ok(()) uri = /metrics/producers
19972024-10-19T04:16:47.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d71b78dd-123e-4119-b866-0644b929842e response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
19982024-10-19T04:16:47.824ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d13f4058-195e-4aa0-9be7-8fb20b81649a
19992024-10-19T04:16:47.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51498 req_id = 644f217a-0fdf-458f-8221-f688957138a0 roles = RoleSet { roles: {} } uri = /metrics/producers
20002024-10-19T04:16:47.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51498 req_id = 644f217a-0fdf-458f-8221-f688957138a0 resource = Database result = Ok(()) uri = /metrics/producers
20012024-10-19T04:16:47.831ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a uri = http://[fd00:1122:3344:101::d]:12223/producers
20022024-10-19T04:16:47.831ZDEBGnexus: client response oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5fcba415-94e8-425a-8bcc-ced13a239414", "date": "Sat, 19 Oct 2024 04:16:47 GMT"} })
20032024-10-19T04:16:47.831ZINFOnexus: assigned collector to new producer collector_id = d13f4058-195e-4aa0-9be7-8fb20b81649a file = nexus/src/app/oximeter.rs:125 producer_id = 8180ea00-0a5e-4377-b19a-82e7e60b09bd
20042024-10-19T04:16:47.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 41134 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51498 req_id = 644f217a-0fdf-458f-8221-f688957138a0 response_code = 201 uri = /metrics/producers
20052024-10-19T04:16:48.496ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:52430
20062024-10-19T04:16:48.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52430 req_id = d155f262-ddd1-4542-baa2-a80412d3ce32 roles = RoleSet { roles: {} } uri = /metrics/producers
20072024-10-19T04:16:48.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52430 req_id = d155f262-ddd1-4542-baa2-a80412d3ce32 resource = Database result = Ok(()) uri = /metrics/producers
20082024-10-19T04:16:48.529ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d13f4058-195e-4aa0-9be7-8fb20b81649a
20092024-10-19T04:16:48.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52430 req_id = d155f262-ddd1-4542-baa2-a80412d3ce32 roles = RoleSet { roles: {} } uri = /metrics/producers
20102024-10-19T04:16:48.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52430 req_id = d155f262-ddd1-4542-baa2-a80412d3ce32 resource = Database result = Ok(()) uri = /metrics/producers
20112024-10-19T04:16:48.536ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a uri = http://[fd00:1122:3344:101::d]:12223/producers
20122024-10-19T04:16:48.536ZDEBGnexus: client response oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8b3ad7c2-a861-4be5-8502-72fb8b7c8a99", "date": "Sat, 19 Oct 2024 04:16:47 GMT"} })
20132024-10-19T04:16:48.536ZINFOnexus: assigned collector to new producer collector_id = d13f4058-195e-4aa0-9be7-8fb20b81649a file = nexus/src/app/oximeter.rs:125 producer_id = 5f76e8b8-af5e-4a08-b5c8-0f54c96da65c
20142024-10-19T04:16:48.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 42557 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52430 req_id = d155f262-ddd1-4542-baa2-a80412d3ce32 response_code = 201 uri = /metrics/producers
20152024-10-19T04:16:48.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1e7c1814-711e-4aa0-b0c7-ce3392704e10 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20162024-10-19T04:16:48.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1e7c1814-711e-4aa0-b0c7-ce3392704e10 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20172024-10-19T04:16:48.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3025 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1e7c1814-711e-4aa0-b0c7-ce3392704e10 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20182024-10-19T04:16:49.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = aa06005c-3d90-4fa4-b928-7e039d7bf921 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20192024-10-19T04:16:49.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = aa06005c-3d90-4fa4-b928-7e039d7bf921 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20202024-10-19T04:16:49.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = aa06005c-3d90-4fa4-b928-7e039d7bf921 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20212024-10-19T04:16:50.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7c20a3a4-4f9a-4976-bf9c-55b244f383ea roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20222024-10-19T04:16:50.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7c20a3a4-4f9a-4976-bf9c-55b244f383ea resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20232024-10-19T04:16:50.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7c20a3a4-4f9a-4976-bf9c-55b244f383ea response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20242024-10-19T04:16:51.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7e744862-0dda-466a-9189-8257712f0ae6 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20252024-10-19T04:16:51.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7e744862-0dda-466a-9189-8257712f0ae6 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20262024-10-19T04:16:51.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7e744862-0dda-466a-9189-8257712f0ae6 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20272024-10-19T04:16:52.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4932c555-808b-4379-89a2-b5259d54846f roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20282024-10-19T04:16:52.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4932c555-808b-4379-89a2-b5259d54846f resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20292024-10-19T04:16:52.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4932c555-808b-4379-89a2-b5259d54846f response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20302024-10-19T04:16:53.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 533c5100-9bb4-4373-b724-e57744a94a9b roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20312024-10-19T04:16:53.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 533c5100-9bb4-4373-b724-e57744a94a9b resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20322024-10-19T04:16:53.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 533c5100-9bb4-4373-b724-e57744a94a9b response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20332024-10-19T04:16:54.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
20342024-10-19T04:16:54.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
20352024-10-19T04:16:54.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20362024-10-19T04:16:54.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20372024-10-19T04:16:54.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20382024-10-19T04:16:54.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20392024-10-19T04:16:54.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20402024-10-19T04:16:54.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20412024-10-19T04:16:54.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20422024-10-19T04:16:54.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.761315ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20432024-10-19T04:16:54.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20442024-10-19T04:16:54.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20452024-10-19T04:16:54.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20462024-10-19T04:16:54.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20472024-10-19T04:16:54.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20482024-10-19T04:16:54.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20492024-10-19T04:16:54.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
20502024-10-19T04:16:54.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20512024-10-19T04:16:54.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20522024-10-19T04:16:54.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
20532024-10-19T04:16:54.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.783631ms iteration = 47 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
20542024-10-19T04:16:54.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a6aaf9af-0b18-4663-9a04-0eee1480122c roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20552024-10-19T04:16:54.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a6aaf9af-0b18-4663-9a04-0eee1480122c resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20562024-10-19T04:16:54.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1682 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a6aaf9af-0b18-4663-9a04-0eee1480122c response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20572024-10-19T04:16:55.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = eda5cc2a-0ce5-45b5-bb57-b16ac7c74181 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20582024-10-19T04:16:55.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = eda5cc2a-0ce5-45b5-bb57-b16ac7c74181 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20592024-10-19T04:16:55.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = eda5cc2a-0ce5-45b5-bb57-b16ac7c74181 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20602024-10-19T04:16:56.359ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:35783
20612024-10-19T04:16:56.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35783 req_id = 1ca60bd7-7624-4e44-9e85-a3d502c3349a roles = RoleSet { roles: {} } uri = /metrics/producers
20622024-10-19T04:16:56.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35783 req_id = 1ca60bd7-7624-4e44-9e85-a3d502c3349a resource = Database result = Ok(()) uri = /metrics/producers
20632024-10-19T04:16:56.391ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d13f4058-195e-4aa0-9be7-8fb20b81649a
20642024-10-19T04:16:56.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35783 req_id = 1ca60bd7-7624-4e44-9e85-a3d502c3349a roles = RoleSet { roles: {} } uri = /metrics/producers
20652024-10-19T04:16:56.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35783 req_id = 1ca60bd7-7624-4e44-9e85-a3d502c3349a resource = Database result = Ok(()) uri = /metrics/producers
20662024-10-19T04:16:56.396ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a uri = http://[fd00:1122:3344:101::d]:12223/producers
20672024-10-19T04:16:56.397ZDEBGnexus: client response oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "85de9543-3b01-4822-a230-d4902d773a6d", "date": "Sat, 19 Oct 2024 04:16:56 GMT"} })
20682024-10-19T04:16:56.397ZINFOnexus: assigned collector to new producer collector_id = d13f4058-195e-4aa0-9be7-8fb20b81649a file = nexus/src/app/oximeter.rs:125 producer_id = caba0976-5752-4cbc-b847-8d7f065750bc
20692024-10-19T04:16:56.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 39386 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35783 req_id = 1ca60bd7-7624-4e44-9e85-a3d502c3349a response_code = 201 uri = /metrics/producers
20702024-10-19T04:16:56.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = b27c9888-6e78-41c5-9fbc-875208250498 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
20712024-10-19T04:16:56.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = b27c9888-6e78-41c5-9fbc-875208250498 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
20722024-10-19T04:16:56.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3512 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = b27c9888-6e78-41c5-9fbc-875208250498 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
20732024-10-19T04:16:56.901ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2079 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = 99e14b8d-77e0-4864-93b1-a510e46b1bc5 response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
20742024-10-19T04:16:56.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 62d96f7d-2783-4138-9db5-5410db8848b8 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20752024-10-19T04:16:56.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 62d96f7d-2783-4138-9db5-5410db8848b8 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20762024-10-19T04:16:56.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 62d96f7d-2783-4138-9db5-5410db8848b8 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20772024-10-19T04:16:58.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 16309632-a6a4-46d9-96fb-2e928b589d4d roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20782024-10-19T04:16:58.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 16309632-a6a4-46d9-96fb-2e928b589d4d resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20792024-10-19T04:16:58.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 16309632-a6a4-46d9-96fb-2e928b589d4d response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20802024-10-19T04:16:58.468ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:35843
20812024-10-19T04:16:58.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35843 req_id = 675139de-a0a7-4f34-855c-7ee381af48b4 roles = RoleSet { roles: {} } uri = /metrics/producers
20822024-10-19T04:16:58.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35843 req_id = 675139de-a0a7-4f34-855c-7ee381af48b4 resource = Database result = Ok(()) uri = /metrics/producers
20832024-10-19T04:16:58.501ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d13f4058-195e-4aa0-9be7-8fb20b81649a
20842024-10-19T04:16:58.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35843 req_id = 675139de-a0a7-4f34-855c-7ee381af48b4 roles = RoleSet { roles: {} } uri = /metrics/producers
20852024-10-19T04:16:58.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35843 req_id = 675139de-a0a7-4f34-855c-7ee381af48b4 resource = Database result = Ok(()) uri = /metrics/producers
20862024-10-19T04:16:58.508ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a uri = http://[fd00:1122:3344:101::d]:12223/producers
20872024-10-19T04:16:58.509ZDEBGnexus: client response oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f59e5c48-ef16-4423-ace8-9fd284bf7c22", "date": "Sat, 19 Oct 2024 04:16:58 GMT"} })
20882024-10-19T04:16:58.509ZINFOnexus: assigned collector to new producer collector_id = d13f4058-195e-4aa0-9be7-8fb20b81649a file = nexus/src/app/oximeter.rs:125 producer_id = 1b5ec442-9210-4f04-ad14-bad1f75b3b07
20892024-10-19T04:16:58.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 41280 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35843 req_id = 675139de-a0a7-4f34-855c-7ee381af48b4 response_code = 201 uri = /metrics/producers
20902024-10-19T04:16:59.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = fb6a0708-d6fc-41ff-900e-9b2e42b432c1 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20912024-10-19T04:16:59.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = fb6a0708-d6fc-41ff-900e-9b2e42b432c1 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20922024-10-19T04:16:59.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = fb6a0708-d6fc-41ff-900e-9b2e42b432c1 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20932024-10-19T04:17:00.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3e8ce5fa-df6d-4902-85ce-942f2dde4139 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20942024-10-19T04:17:00.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3e8ce5fa-df6d-4902-85ce-942f2dde4139 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20952024-10-19T04:17:00.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2192 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3e8ce5fa-df6d-4902-85ce-942f2dde4139 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20962024-10-19T04:17:01.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = dc56e25d-5840-4c9b-b6e9-91f984b31c3c roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20972024-10-19T04:17:01.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = dc56e25d-5840-4c9b-b6e9-91f984b31c3c resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20982024-10-19T04:17:01.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = dc56e25d-5840-4c9b-b6e9-91f984b31c3c response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
20992024-10-19T04:17:01.740ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:48258
21002024-10-19T04:17:01.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48258 req_id = b70354b2-2774-4b42-a79b-105145c5b180 roles = RoleSet { roles: {} } uri = /metrics/producers
21012024-10-19T04:17:01.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48258 req_id = b70354b2-2774-4b42-a79b-105145c5b180 resource = Database result = Ok(()) uri = /metrics/producers
21022024-10-19T04:17:01.773ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d13f4058-195e-4aa0-9be7-8fb20b81649a
21032024-10-19T04:17:01.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48258 req_id = b70354b2-2774-4b42-a79b-105145c5b180 roles = RoleSet { roles: {} } uri = /metrics/producers
21042024-10-19T04:17:01.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48258 req_id = b70354b2-2774-4b42-a79b-105145c5b180 resource = Database result = Ok(()) uri = /metrics/producers
21052024-10-19T04:17:01.778ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a uri = http://[fd00:1122:3344:101::d]:12223/producers
21062024-10-19T04:17:01.778ZDEBGnexus: client response oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7cea7fb5-986b-4b82-8f12-72215c9a799d", "date": "Sat, 19 Oct 2024 04:17:01 GMT"} })
21072024-10-19T04:17:01.778ZINFOnexus: assigned collector to new producer collector_id = d13f4058-195e-4aa0-9be7-8fb20b81649a file = nexus/src/app/oximeter.rs:125 producer_id = 58100a28-9c4f-46bc-93e2-df5bdfc31441
21082024-10-19T04:17:01.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 39638 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48258 req_id = b70354b2-2774-4b42-a79b-105145c5b180 response_code = 201 uri = /metrics/producers
21092024-10-19T04:17:02.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e09ebdae-bd85-4b7a-ad42-e93821ef28d2 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21102024-10-19T04:17:02.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e09ebdae-bd85-4b7a-ad42-e93821ef28d2 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21112024-10-19T04:17:02.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e09ebdae-bd85-4b7a-ad42-e93821ef28d2 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21122024-10-19T04:17:03.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0dd566c7-d447-4dbb-a230-c0275ccceee5 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21132024-10-19T04:17:03.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0dd566c7-d447-4dbb-a230-c0275ccceee5 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21142024-10-19T04:17:03.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0dd566c7-d447-4dbb-a230-c0275ccceee5 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21152024-10-19T04:17:04.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 46cc976c-71fc-4fe2-a258-114793e7b102 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21162024-10-19T04:17:04.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 46cc976c-71fc-4fe2-a258-114793e7b102 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21172024-10-19T04:17:04.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 46cc976c-71fc-4fe2-a258-114793e7b102 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21182024-10-19T04:17:04.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
21192024-10-19T04:17:04.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
21202024-10-19T04:17:04.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21212024-10-19T04:17:04.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21222024-10-19T04:17:04.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21232024-10-19T04:17:04.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21242024-10-19T04:17:04.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21252024-10-19T04:17:04.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21262024-10-19T04:17:04.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21272024-10-19T04:17:04.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.861036ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21282024-10-19T04:17:04.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21292024-10-19T04:17:04.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21302024-10-19T04:17:04.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21312024-10-19T04:17:04.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21322024-10-19T04:17:04.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21332024-10-19T04:17:04.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21342024-10-19T04:17:04.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
21352024-10-19T04:17:04.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21362024-10-19T04:17:04.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21372024-10-19T04:17:04.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
21382024-10-19T04:17:04.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.212689ms iteration = 48 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
21392024-10-19T04:17:05.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = c332d96a-7c21-4cfe-bc03-5003b894feb3 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21402024-10-19T04:17:05.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = c332d96a-7c21-4cfe-bc03-5003b894feb3 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21412024-10-19T04:17:05.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = c332d96a-7c21-4cfe-bc03-5003b894feb3 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21422024-10-19T04:17:06.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4b695075-a874-49b9-a26b-eba32b7cf710 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21432024-10-19T04:17:06.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4b695075-a874-49b9-a26b-eba32b7cf710 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21442024-10-19T04:17:06.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4b695075-a874-49b9-a26b-eba32b7cf710 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21452024-10-19T04:17:06.900ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1481 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = be820f3e-8918-4d0e-8099-2812a41390b8 response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
21462024-10-19T04:17:07.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 645e54c2-661b-4bc9-905e-1d0dedd58b59 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21472024-10-19T04:17:07.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 645e54c2-661b-4bc9-905e-1d0dedd58b59 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21482024-10-19T04:17:07.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 645e54c2-661b-4bc9-905e-1d0dedd58b59 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21492024-10-19T04:17:08.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 66837ab6-b0fd-416d-b611-696c9fffac2f roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21502024-10-19T04:17:08.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 66837ab6-b0fd-416d-b611-696c9fffac2f resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21512024-10-19T04:17:08.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2732 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 66837ab6-b0fd-416d-b611-696c9fffac2f response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21522024-10-19T04:17:09.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1e35290d-a987-403e-ae0b-75c04b30c9e0 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21532024-10-19T04:17:09.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1e35290d-a987-403e-ae0b-75c04b30c9e0 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21542024-10-19T04:17:09.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1e35290d-a987-403e-ae0b-75c04b30c9e0 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21552024-10-19T04:17:10.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0aee12ad-6e12-495f-9396-62d683f10af3 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21562024-10-19T04:17:10.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0aee12ad-6e12-495f-9396-62d683f10af3 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21572024-10-19T04:17:10.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0aee12ad-6e12-495f-9396-62d683f10af3 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21582024-10-19T04:17:11.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 69b89e8f-792f-4cca-9698-6c67b27cd394 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21592024-10-19T04:17:11.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 69b89e8f-792f-4cca-9698-6c67b27cd394 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21602024-10-19T04:17:11.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 69b89e8f-792f-4cca-9698-6c67b27cd394 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21612024-10-19T04:17:12.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7bd6e4dc-6be5-45d9-8c85-2472b529fd40 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21622024-10-19T04:17:12.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7bd6e4dc-6be5-45d9-8c85-2472b529fd40 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21632024-10-19T04:17:12.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7bd6e4dc-6be5-45d9-8c85-2472b529fd40 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21642024-10-19T04:17:13.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e483455c-31e1-4809-af70-362fa57da6f6 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21652024-10-19T04:17:13.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e483455c-31e1-4809-af70-362fa57da6f6 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21662024-10-19T04:17:13.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e483455c-31e1-4809-af70-362fa57da6f6 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21672024-10-19T04:17:14.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7c7c449b-57a4-4b01-b1fd-4e61f424cded roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21682024-10-19T04:17:14.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7c7c449b-57a4-4b01-b1fd-4e61f424cded resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21692024-10-19T04:17:14.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2837 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7c7c449b-57a4-4b01-b1fd-4e61f424cded response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
21702024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
21712024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
21722024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
21732024-10-19T04:17:14.859ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931
21742024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21752024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.99\u{b5}s iteration = 10 status = {"error":"blueprint disabled","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931"}
21762024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
21772024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
21782024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
21792024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
21802024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
21812024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
21822024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
21832024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21842024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21852024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
21862024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
21872024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21882024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
21892024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
21902024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21912024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
21922024-10-19T04:17:14.859ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
21932024-10-19T04:17:14.859ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
21942024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
21952024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
21962024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
21972024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21982024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
21992024-10-19T04:17:14.860ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
22002024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
22012024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22022024-10-19T04:17:14.860ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-19 04:07:14.859896242 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
22032024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
22042024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
22052024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22062024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
22072024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22082024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
22092024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22102024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
22112024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22122024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
22132024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22142024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
22152024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
22162024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22172024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
22182024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22192024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22202024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
22212024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
22222024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
22232024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
22242024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
22252024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22262024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22272024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22282024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
22292024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22302024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22312024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22322024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
22332024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22342024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22352024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22362024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22372024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22382024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22392024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
22402024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22412024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
22422024-10-19T04:17:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22432024-10-19T04:17:14.861ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("077283a3-2f69-419e-8ab2-1088c51300c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f0b5b4d-c580-4418-9bbc-5d1b6d257b94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a79265b8-3f31-40c4-bdbb-3f2463bd3c30.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a79265b8-3f31-40c4-bdbb-3f2463bd3c30.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 8800, tv_nsec: 970205973 } })
22442024-10-19T04:17:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
22452024-10-19T04:17:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22462024-10-19T04:17:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22472024-10-19T04:17:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22482024-10-19T04:17:14.861ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22492024-10-19T04:17:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22502024-10-19T04:17:14.862ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3881ebd6-060e-4a3f-8035-5fd76566e5d0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4ba9b73a-0f82-489d-a9fb-902be604440b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("4ba9b73a-0f82-489d-a9fb-902be604440b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 8800, tv_nsec: 971236613 } })
22512024-10-19T04:17:14.862ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22522024-10-19T04:17:14.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22532024-10-19T04:17:14.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22542024-10-19T04:17:14.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22552024-10-19T04:17:14.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22562024-10-19T04:17:14.863ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.007819ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
22572024-10-19T04:17:14.863ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
22582024-10-19T04:17:14.863ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.997179ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
22592024-10-19T04:17:14.863ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
22602024-10-19T04:17:14.863ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.698173ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
22612024-10-19T04:17:14.863ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
22622024-10-19T04:17:14.863ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
22632024-10-19T04:17:14.863ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 3.999498ms iteration = 9 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
22642024-10-19T04:17:14.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22652024-10-19T04:17:14.864ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22662024-10-19T04:17:14.864ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
22672024-10-19T04:17:14.864ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
22682024-10-19T04:17:14.864ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22692024-10-19T04:17:14.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22702024-10-19T04:17:14.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22712024-10-19T04:17:14.865ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8800, tv_nsec: 974677291 } })
22722024-10-19T04:17:14.865ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
22732024-10-19T04:17:14.866ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.306894ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
22742024-10-19T04:17:14.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22752024-10-19T04:17:14.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22762024-10-19T04:17:14.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.511898ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
22772024-10-19T04:17:14.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22782024-10-19T04:17:14.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
22792024-10-19T04:17:14.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22802024-10-19T04:17:14.866ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
22812024-10-19T04:17:14.866ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
22822024-10-19T04:17:14.866ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 7.10145ms iteration = 17 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
22832024-10-19T04:17:14.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22842024-10-19T04:17:14.867ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22852024-10-19T04:17:14.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22862024-10-19T04:17:14.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22872024-10-19T04:17:14.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22882024-10-19T04:17:14.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22892024-10-19T04:17:14.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22902024-10-19T04:17:14.868ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22912024-10-19T04:17:14.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22922024-10-19T04:17:14.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22932024-10-19T04:17:14.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
22942024-10-19T04:17:14.868ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22952024-10-19T04:17:14.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22962024-10-19T04:17:14.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22972024-10-19T04:17:14.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 9.09936ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22982024-10-19T04:17:14.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22992024-10-19T04:17:14.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23002024-10-19T04:17:14.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23012024-10-19T04:17:14.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23022024-10-19T04:17:14.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23032024-10-19T04:17:14.870ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23042024-10-19T04:17:14.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
23052024-10-19T04:17:14.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23062024-10-19T04:17:14.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23072024-10-19T04:17:14.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23082024-10-19T04:17:14.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23092024-10-19T04:17:14.870ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
23102024-10-19T04:17:14.870ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
23112024-10-19T04:17:14.870ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 10.969747ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
23122024-10-19T04:17:14.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23132024-10-19T04:17:14.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
23142024-10-19T04:17:14.871ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23152024-10-19T04:17:14.871ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23162024-10-19T04:17:14.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23172024-10-19T04:17:14.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23182024-10-19T04:17:14.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23192024-10-19T04:17:14.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23202024-10-19T04:17:14.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23212024-10-19T04:17:14.872ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 12.246081ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
23222024-10-19T04:17:14.872ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8800, tv_nsec: 981670479 } })
23232024-10-19T04:17:14.872ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
23242024-10-19T04:17:14.872ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23252024-10-19T04:17:14.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23262024-10-19T04:17:14.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23272024-10-19T04:17:14.873ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 13.270782ms iteration = 17 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
23282024-10-19T04:17:14.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23292024-10-19T04:17:14.873ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
23302024-10-19T04:17:14.873ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 13.435545ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
23312024-10-19T04:17:14.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23322024-10-19T04:17:14.874ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8800, tv_nsec: 983246540 } })
23332024-10-19T04:17:14.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23342024-10-19T04:17:14.874ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23352024-10-19T04:17:14.874ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
23362024-10-19T04:17:14.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23372024-10-19T04:17:14.874ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23382024-10-19T04:17:14.874ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
23392024-10-19T04:17:14.874ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
23402024-10-19T04:17:14.874ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
23412024-10-19T04:17:14.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23422024-10-19T04:17:14.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23432024-10-19T04:17:14.874ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-19 04:07:14.859896242 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
23442024-10-19T04:17:14.874ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.934084ms iteration = 9 status = {"expiration":"2024-10-19T04:07:14.859896242Z","pruned":[]}
23452024-10-19T04:17:14.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
23462024-10-19T04:17:14.874ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23472024-10-19T04:17:14.874ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
23482024-10-19T04:17:14.874ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
23492024-10-19T04:17:14.874ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
23502024-10-19T04:17:14.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23512024-10-19T04:17:14.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23522024-10-19T04:17:14.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23532024-10-19T04:17:14.876ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23542024-10-19T04:17:14.876ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23552024-10-19T04:17:14.876ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23562024-10-19T04:17:14.876ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23572024-10-19T04:17:14.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23582024-10-19T04:17:14.878ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23592024-10-19T04:17:14.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23602024-10-19T04:17:14.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23612024-10-19T04:17:14.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23622024-10-19T04:17:14.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23632024-10-19T04:17:14.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23642024-10-19T04:17:14.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23652024-10-19T04:17:14.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23662024-10-19T04:17:14.879ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23672024-10-19T04:17:14.879ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
23682024-10-19T04:17:14.879ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a4077ac0-652e-4998-9c99-e66a22abccb6 dns_zone_name = oxide.test found_so_far = 0 version = 2
23692024-10-19T04:17:14.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23702024-10-19T04:17:14.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23712024-10-19T04:17:14.880ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
23722024-10-19T04:17:14.880ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = fb44ee4c-c5ec-4992-abdf-b6f7e2fadda5 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
23732024-10-19T04:17:14.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23742024-10-19T04:17:14.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23752024-10-19T04:17:14.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23762024-10-19T04:17:14.881ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
23772024-10-19T04:17:14.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23782024-10-19T04:17:14.881ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.660816ms iteration = 49 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
23792024-10-19T04:17:14.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
23802024-10-19T04:17:14.881ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23812024-10-19T04:17:14.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23822024-10-19T04:17:14.882ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23832024-10-19T04:17:14.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23842024-10-19T04:17:14.883ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 23.34463ms iteration = 20 status = {"physical_disks_added":0}
23852024-10-19T04:17:14.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23862024-10-19T04:17:14.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23872024-10-19T04:17:14.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23882024-10-19T04:17:14.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23892024-10-19T04:17:14.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23902024-10-19T04:17:14.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23912024-10-19T04:17:14.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23922024-10-19T04:17:14.884ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23932024-10-19T04:17:14.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23942024-10-19T04:17:14.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23952024-10-19T04:17:14.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23962024-10-19T04:17:14.884ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a4077ac0-652e-4998-9c99-e66a22abccb6 dns_zone_name = oxide.test found_so_far = 1 version = 2
23972024-10-19T04:17:14.884ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
23982024-10-19T04:17:14.884ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-19 04:10:05.874167 UTC dns_group = external generation = 2
23992024-10-19T04:17:14.884ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 25.112225ms iteration = 10 status = {"generation":2}
24002024-10-19T04:17:14.885ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24012024-10-19T04:17:14.885ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24022024-10-19T04:17:14.885ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24032024-10-19T04:17:14.885ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = fb44ee4c-c5ec-4992-abdf-b6f7e2fadda5 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
24042024-10-19T04:17:14.885ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
24052024-10-19T04:17:14.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24062024-10-19T04:17:14.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24072024-10-19T04:17:14.885ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-19 04:10:05.441343 UTC dns_group = internal generation = 1
24082024-10-19T04:17:14.885ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 26.36175ms iteration = 10 status = {"generation":1}
24092024-10-19T04:17:14.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24102024-10-19T04:17:14.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8180ea00-0a5e-4377-b19a-82e7e60b09bd, lookup_type: ById(8180ea00-0a5e-4377-b19a-82e7e60b09bd) } result = Ok(())
24112024-10-19T04:17:14.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24122024-10-19T04:17:14.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24132024-10-19T04:17:14.891ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 31.082842ms iteration = 17 status = 0
24142024-10-19T04:17:14.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24152024-10-19T04:17:14.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24162024-10-19T04:17:14.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24172024-10-19T04:17:14.894ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-19T04:09:14.003740Z, time_modified: 2024-10-19T04:09:14.003740Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, db_silo: Silo { identity: SiloIdentity { id: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-19T04:10:05.838166Z, time_modified: 2024-10-19T04:10:05.838166Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1f4033bd55b23e094b1263660016971c2c68cc6162a83dcd709c701bd968e3c5" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, db_silo: Silo { identity: SiloIdentity { id: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-19T04:10:05.838166Z, time_modified: 2024-10-19T04:10:05.838166Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1f4033bd55b23e094b1263660016971c2c68cc6162a83dcd709c701bd968e3c5" }] }) }
24182024-10-19T04:17:14.894ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 34.194463ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"54ab3538-1bb1-4d5e-a518-5d0dec26f2d7","tls_certs":["1f4033bd55b23e094b1263660016971c2c68cc6162a83dcd709c701bd968e3c5"]}},"default_endpoint":{"silo_id":"54ab3538-1bb1-4d5e-a518-5d0dec26f2d7","tls_certs":["1f4033bd55b23e094b1263660016971c2c68cc6162a83dcd709c701bd968e3c5"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
24192024-10-19T04:17:14.895ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24202024-10-19T04:17:14.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24212024-10-19T04:17:14.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24222024-10-19T04:17:14.896ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24232024-10-19T04:17:14.898ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24242024-10-19T04:17:14.898ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24252024-10-19T04:17:14.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24262024-10-19T04:17:15.038ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
24272024-10-19T04:17:15.038ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24282024-10-19T04:17:15.039ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9afad0ae-b0f0-4fea-86d0-8219a34ec032", "content-length": "26", "date": "Sat, 19 Oct 2024 04:17:15 GMT"} })
24292024-10-19T04:17:15.039ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24302024-10-19T04:17:15.039ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
24312024-10-19T04:17:15.040ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24322024-10-19T04:17:15.060ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
24332024-10-19T04:17:15.102ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 zone_address = fd00:1122:3344:101::2
24342024-10-19T04:17:15.102ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24352024-10-19T04:17:15.104ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "81de4fc0-18f4-4805-80f4-161a48be4f46", "content-length": "26", "date": "Sat, 19 Oct 2024 04:17:15 GMT"} })
24362024-10-19T04:17:15.104ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24372024-10-19T04:17:15.105ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24382024-10-19T04:17:15.105ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
24392024-10-19T04:17:15.106ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bc382536-b2c1-461d-93db-a572c2ee29ff", "content-length": "691", "date": "Sat, 19 Oct 2024 04:17:15 GMT"} })
24402024-10-19T04:17:15.106ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
24412024-10-19T04:17:15.106ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
24422024-10-19T04:17:15.106ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
24432024-10-19T04:17:15.108ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 248.186149ms iteration = 18 status = {}
24442024-10-19T04:17:15.208ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
24452024-10-19T04:17:15.209ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
24462024-10-19T04:17:15.210ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "612158d2-7673-4eb3-b9ab-6d8d46a00c9a", "content-length": "2", "date": "Sat, 19 Oct 2024 04:17:14 GMT"} })
24472024-10-19T04:17:15.211ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24482024-10-19T04:17:15.212ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24492024-10-19T04:17:15.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24502024-10-19T04:17:15.212ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5e13c205-6083-434a-bc02-b8917c6519ae", "content-length": "372", "date": "Sat, 19 Oct 2024 04:17:15 GMT"} })
24512024-10-19T04:17:15.212ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24522024-10-19T04:17:15.212ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
24532024-10-19T04:17:15.212ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24542024-10-19T04:17:15.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24552024-10-19T04:17:15.212ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e112364e-c626-4286-ab5a-a69605709d0b", "content-length": "26", "date": "Sat, 19 Oct 2024 04:17:15 GMT"} })
24562024-10-19T04:17:15.212ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24572024-10-19T04:17:15.213ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 353.618226ms iteration = 17 status = null
24582024-10-19T04:17:15.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24592024-10-19T04:17:15.214ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24602024-10-19T04:17:15.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24612024-10-19T04:17:15.216ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24622024-10-19T04:17:15.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24632024-10-19T04:17:15.219ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24642024-10-19T04:17:15.220ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b4ef4615-905f-45a3-8d70-449db12748f7", "date": "Sat, 19 Oct 2024 04:17:15 GMT"} })
24652024-10-19T04:17:15.222ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 362.871809ms iteration = 19 status = {}
24662024-10-19T04:17:15.233ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
24672024-10-19T04:17:15.233ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "71758cfa-a86d-481d-99fd-e08e99637f9d", "date": "Sat, 19 Oct 2024 04:17:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24682024-10-19T04:17:15.233ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24692024-10-19T04:17:15.236ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "81e5bc1c-0ecb-4b32-9f9d-d78f3bc6eba4", "date": "Sat, 19 Oct 2024 04:17:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24702024-10-19T04:17:15.236ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24712024-10-19T04:17:15.237ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24722024-10-19T04:17:15.237ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 377.68582ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
24732024-10-19T04:17:15.309ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
24742024-10-19T04:17:15.310ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "062e8653-f279-455f-b5f5-e790d348b4da", "date": "Sat, 19 Oct 2024 04:17:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
24752024-10-19T04:17:15.310ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
24762024-10-19T04:17:15.312ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4ddb3a14-a5c7-4fab-a00a-5af3c79cd163", "date": "Sat, 19 Oct 2024 04:17:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
24772024-10-19T04:17:15.312ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
24782024-10-19T04:17:15.313ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 453.84175ms iteration = 17 status = {}
24792024-10-19T04:17:15.314ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "61896250-4d8c-43ce-91a7-64fd8877d63b", "date": "Sat, 19 Oct 2024 04:17:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
24802024-10-19T04:17:15.315ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
24812024-10-19T04:17:15.317ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
24822024-10-19T04:17:15.317ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 457.386011ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
24832024-10-19T04:17:15.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24842024-10-19T04:17:15.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24852024-10-19T04:17:15.354ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 67c66fb2-5b53-4f7b-be0b-63b92427bb54, rack_id: 7a4ab4db-4586-4060-be07-8fb242636fc1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ce7dad06-a40f-46ae-96ea-31487ccc19ce) } rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0
24862024-10-19T04:17:15.354ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24872024-10-19T04:17:15.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24882024-10-19T04:17:15.361ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
24892024-10-19T04:17:15.361ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a7198461-ea85-47bc-a731-e7a8eb4ee87e", "content-length": "121", "date": "Sat, 19 Oct 2024 04:17:14 GMT"} })
24902024-10-19T04:17:15.361ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
24912024-10-19T04:17:15.361ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ce7dad06-a40f-46ae-96ea-31487ccc19ce
24922024-10-19T04:17:15.361ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24932024-10-19T04:17:15.361ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24942024-10-19T04:17:15.361ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {}
24952024-10-19T04:17:15.361ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {}
24962024-10-19T04:17:15.361ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
24972024-10-19T04:17:15.361ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24982024-10-19T04:17:15.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24992024-10-19T04:17:15.363ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
25002024-10-19T04:17:15.364ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "133d8b73-b2ea-43d4-bca8-61c0eeecf3f3", "content-length": "2", "date": "Sat, 19 Oct 2024 04:17:14 GMT"} })
25012024-10-19T04:17:15.364ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
25022024-10-19T04:17:15.364ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bd4a0e16-1de4-47a5-91fe-f206829ed667", "content-length": "52", "date": "Sat, 19 Oct 2024 04:17:14 GMT"} })
25032024-10-19T04:17:15.364ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0
25042024-10-19T04:17:15.364ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
25052024-10-19T04:17:15.458ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9ffe4d59-97e2-431a-8605-1bb3702a3cd0", "date": "Sat, 19 Oct 2024 04:17:15 GMT"} })
25062024-10-19T04:17:15.458ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch = Switch0
25072024-10-19T04:17:15.458ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
25082024-10-19T04:17:15.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 642ce8fb-519b-46f2-9ff0-934013579e92 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25092024-10-19T04:17:15.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 642ce8fb-519b-46f2-9ff0-934013579e92 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25102024-10-19T04:17:15.459ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "facf122c-9136-4925-9408-d43c0f95b2f3", "content-length": "667", "date": "Sat, 19 Oct 2024 04:17:15 GMT"} })
25112024-10-19T04:17:15.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25122024-10-19T04:17:15.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25132024-10-19T04:17:15.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1891 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 642ce8fb-519b-46f2-9ff0-934013579e92 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25142024-10-19T04:17:15.462ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25152024-10-19T04:17:15.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25162024-10-19T04:17:15.465ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25172024-10-19T04:17:15.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25182024-10-19T04:17:15.467ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25192024-10-19T04:17:15.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25202024-10-19T04:17:15.474ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 614.296861ms iteration = 17 status = {}
25212024-10-19T04:17:16.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 77ea99a1-fabb-4899-acd2-769679e635d4 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25222024-10-19T04:17:16.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 77ea99a1-fabb-4899-acd2-769679e635d4 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25232024-10-19T04:17:16.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 77ea99a1-fabb-4899-acd2-769679e635d4 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25242024-10-19T04:17:16.901ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2025 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = bc263208-bc0d-407b-8925-e57a96c0bec4 response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
25252024-10-19T04:17:17.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 8e9e0a58-c2a5-4f11-b534-00d93405c650 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25262024-10-19T04:17:17.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 8e9e0a58-c2a5-4f11-b534-00d93405c650 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25272024-10-19T04:17:17.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 8e9e0a58-c2a5-4f11-b534-00d93405c650 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25282024-10-19T04:17:18.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0282bfab-c419-4c57-a489-b677698d4fd8 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25292024-10-19T04:17:18.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0282bfab-c419-4c57-a489-b677698d4fd8 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25302024-10-19T04:17:18.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0282bfab-c419-4c57-a489-b677698d4fd8 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25312024-10-19T04:17:19.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 95ab7293-c1a6-4273-b6cd-26f3b0388400 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25322024-10-19T04:17:19.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 95ab7293-c1a6-4273-b6cd-26f3b0388400 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25332024-10-19T04:17:19.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 95ab7293-c1a6-4273-b6cd-26f3b0388400 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25342024-10-19T04:17:20.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f28de435-5ec2-4061-abd0-8043d6f90e03 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25352024-10-19T04:17:20.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f28de435-5ec2-4061-abd0-8043d6f90e03 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25362024-10-19T04:17:20.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2079 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f28de435-5ec2-4061-abd0-8043d6f90e03 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25372024-10-19T04:17:21.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0cd6b6c9-0d16-4869-9c30-9a81b1777fb3 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25382024-10-19T04:17:21.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0cd6b6c9-0d16-4869-9c30-9a81b1777fb3 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25392024-10-19T04:17:21.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2339 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0cd6b6c9-0d16-4869-9c30-9a81b1777fb3 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25402024-10-19T04:17:22.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 58b64c57-eaa7-4d5a-95ea-1f3d9a47ed57 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25412024-10-19T04:17:22.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 58b64c57-eaa7-4d5a-95ea-1f3d9a47ed57 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25422024-10-19T04:17:22.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 58b64c57-eaa7-4d5a-95ea-1f3d9a47ed57 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25432024-10-19T04:17:23.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ecd2fa43-785a-4213-9de2-c0ce8efbc099 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25442024-10-19T04:17:23.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ecd2fa43-785a-4213-9de2-c0ce8efbc099 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25452024-10-19T04:17:23.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3147 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ecd2fa43-785a-4213-9de2-c0ce8efbc099 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25462024-10-19T04:17:24.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2cf2b97f-20fc-4b13-a38d-0d6856673e57 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25472024-10-19T04:17:24.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2cf2b97f-20fc-4b13-a38d-0d6856673e57 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25482024-10-19T04:17:24.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2cf2b97f-20fc-4b13-a38d-0d6856673e57 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25492024-10-19T04:17:24.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
25502024-10-19T04:17:24.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25512024-10-19T04:17:24.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
25522024-10-19T04:17:24.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25532024-10-19T04:17:24.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25542024-10-19T04:17:24.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25552024-10-19T04:17:24.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25562024-10-19T04:17:24.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25572024-10-19T04:17:24.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25582024-10-19T04:17:24.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.838736ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25592024-10-19T04:17:24.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25602024-10-19T04:17:24.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25612024-10-19T04:17:24.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25622024-10-19T04:17:24.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25632024-10-19T04:17:24.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25642024-10-19T04:17:24.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25652024-10-19T04:17:24.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
25662024-10-19T04:17:24.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25672024-10-19T04:17:24.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25682024-10-19T04:17:24.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
25692024-10-19T04:17:24.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.888593ms iteration = 50 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
25702024-10-19T04:17:25.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = dfcad9df-fc60-4a8b-a618-4327c6c18359 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25712024-10-19T04:17:25.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = dfcad9df-fc60-4a8b-a618-4327c6c18359 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25722024-10-19T04:17:25.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2632 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = dfcad9df-fc60-4a8b-a618-4327c6c18359 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25732024-10-19T04:17:26.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = e80c3437-62c0-4582-aec2-caf8d5b50534 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
25742024-10-19T04:17:26.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = e80c3437-62c0-4582-aec2-caf8d5b50534 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
25752024-10-19T04:17:26.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3085 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = e80c3437-62c0-4582-aec2-caf8d5b50534 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
25762024-10-19T04:17:26.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5768daa4-f16b-44a1-90ac-81d1f66244a4 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25772024-10-19T04:17:26.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5768daa4-f16b-44a1-90ac-81d1f66244a4 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25782024-10-19T04:17:26.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5768daa4-f16b-44a1-90ac-81d1f66244a4 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25792024-10-19T04:17:26.901ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1635 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = 92b5b68f-9734-43cc-8654-d55265965bb4 response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
25802024-10-19T04:17:27.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0df21563-a868-4b06-8496-ed737f5188d9 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25812024-10-19T04:17:27.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0df21563-a868-4b06-8496-ed737f5188d9 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25822024-10-19T04:17:27.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2550 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0df21563-a868-4b06-8496-ed737f5188d9 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25832024-10-19T04:17:28.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = dc135e06-827d-41e2-8f95-fb40a8b0981f roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25842024-10-19T04:17:28.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = dc135e06-827d-41e2-8f95-fb40a8b0981f resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25852024-10-19T04:17:28.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = dc135e06-827d-41e2-8f95-fb40a8b0981f response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25862024-10-19T04:17:29.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1276d485-dcac-41b1-9e1e-e0f474467784 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25872024-10-19T04:17:29.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1276d485-dcac-41b1-9e1e-e0f474467784 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25882024-10-19T04:17:29.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1276d485-dcac-41b1-9e1e-e0f474467784 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25892024-10-19T04:17:30.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 058b3712-83c0-4ef0-bb1b-0ad5358eae8a roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25902024-10-19T04:17:30.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 058b3712-83c0-4ef0-bb1b-0ad5358eae8a resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25912024-10-19T04:17:30.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1980 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 058b3712-83c0-4ef0-bb1b-0ad5358eae8a response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25922024-10-19T04:17:31.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 13aa42ed-9c8d-45d1-991c-905762eb51ac roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25932024-10-19T04:17:31.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 13aa42ed-9c8d-45d1-991c-905762eb51ac resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25942024-10-19T04:17:31.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 13aa42ed-9c8d-45d1-991c-905762eb51ac response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25952024-10-19T04:17:32.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 92e69f44-cb94-4891-acae-cc2857e1a37a roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25962024-10-19T04:17:32.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 92e69f44-cb94-4891-acae-cc2857e1a37a resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25972024-10-19T04:17:32.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2624 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 92e69f44-cb94-4891-acae-cc2857e1a37a response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25982024-10-19T04:17:33.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 41345472-a4a4-467d-b50f-4366f942df48 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
25992024-10-19T04:17:33.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 41345472-a4a4-467d-b50f-4366f942df48 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26002024-10-19T04:17:33.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1830 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 41345472-a4a4-467d-b50f-4366f942df48 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26012024-10-19T04:17:34.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
26022024-10-19T04:17:34.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26032024-10-19T04:17:34.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
26042024-10-19T04:17:34.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26052024-10-19T04:17:34.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26062024-10-19T04:17:34.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26072024-10-19T04:17:34.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26082024-10-19T04:17:34.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26092024-10-19T04:17:34.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26102024-10-19T04:17:34.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.304465ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26112024-10-19T04:17:34.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f1966a7f-17c3-4a21-8956-51c8b6eaed4b roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26122024-10-19T04:17:34.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f1966a7f-17c3-4a21-8956-51c8b6eaed4b resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26132024-10-19T04:17:34.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26142024-10-19T04:17:34.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26152024-10-19T04:17:34.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26162024-10-19T04:17:34.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f1966a7f-17c3-4a21-8956-51c8b6eaed4b response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26172024-10-19T04:17:34.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26182024-10-19T04:17:34.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26192024-10-19T04:17:34.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26202024-10-19T04:17:34.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
26212024-10-19T04:17:34.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26222024-10-19T04:17:34.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26232024-10-19T04:17:34.883ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
26242024-10-19T04:17:34.883ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.447682ms iteration = 51 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
26252024-10-19T04:17:35.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 55a240f6-a547-4a68-b56b-4b5b2b57c888 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26262024-10-19T04:17:35.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 55a240f6-a547-4a68-b56b-4b5b2b57c888 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26272024-10-19T04:17:35.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1745 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 55a240f6-a547-4a68-b56b-4b5b2b57c888 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26282024-10-19T04:17:36.901ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1786 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = b89678e5-f6cc-4ae1-9d63-c04c4d57be96 response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
26292024-10-19T04:17:36.901ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
26302024-10-19T04:17:36.901ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
26312024-10-19T04:17:36.933ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
26322024-10-19T04:17:36.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 606eece6-8c89-415d-b854-95c70861a85a roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26332024-10-19T04:17:36.933ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:55065
26342024-10-19T04:17:36.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:55065 req_id = 40d2c906-f655-4908-b77d-4167a437525f roles = RoleSet { roles: {} } uri = /metrics/producers
26352024-10-19T04:17:36.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 606eece6-8c89-415d-b854-95c70861a85a resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26362024-10-19T04:17:36.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:55065 req_id = 40d2c906-f655-4908-b77d-4167a437525f resource = Database result = Ok(()) uri = /metrics/producers
26372024-10-19T04:17:36.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1846 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 606eece6-8c89-415d-b854-95c70861a85a response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26382024-10-19T04:17:36.967ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d13f4058-195e-4aa0-9be7-8fb20b81649a
26392024-10-19T04:17:36.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:55065 req_id = 40d2c906-f655-4908-b77d-4167a437525f roles = RoleSet { roles: {} } uri = /metrics/producers
26402024-10-19T04:17:36.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:55065 req_id = 40d2c906-f655-4908-b77d-4167a437525f resource = Database result = Ok(()) uri = /metrics/producers
26412024-10-19T04:17:36.972ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a uri = http://[fd00:1122:3344:101::d]:12223/producers
26422024-10-19T04:17:36.972ZDEBGnexus: client response oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5dfee872-5fec-4f29-8722-acf050d2ada5", "date": "Sat, 19 Oct 2024 04:17:36 GMT"} })
26432024-10-19T04:17:36.972ZINFOnexus: assigned collector to new producer collector_id = d13f4058-195e-4aa0-9be7-8fb20b81649a file = nexus/src/app/oximeter.rs:125 producer_id = 613e815e-cc58-43ed-80bc-ffd165040e7b
26442024-10-19T04:17:36.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 40125 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:55065 req_id = 40d2c906-f655-4908-b77d-4167a437525f response_code = 201 uri = /metrics/producers
26452024-10-19T04:17:36.973ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "40d2c906-f655-4908-b77d-4167a437525f", "content-length": "41", "date": "Sat, 19 Oct 2024 04:17:36 GMT"} })
26462024-10-19T04:17:36.975ZDEBGnexus (producer-registration-task): registered with nexus successfully
26472024-10-19T04:17:36.975ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
26482024-10-19T04:17:37.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 8ab4deb9-11ee-42f3-ab94-67748534efea roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26492024-10-19T04:17:37.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 8ab4deb9-11ee-42f3-ab94-67748534efea resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26502024-10-19T04:17:37.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1684 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 8ab4deb9-11ee-42f3-ab94-67748534efea response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26512024-10-19T04:17:38.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1d548422-59aa-40dc-91f3-ee8b0ee39db4 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26522024-10-19T04:17:38.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1d548422-59aa-40dc-91f3-ee8b0ee39db4 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26532024-10-19T04:17:38.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1d548422-59aa-40dc-91f3-ee8b0ee39db4 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26542024-10-19T04:17:40.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6819a7f1-1a1d-4a8a-83f5-b82bdccef597 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26552024-10-19T04:17:40.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6819a7f1-1a1d-4a8a-83f5-b82bdccef597 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26562024-10-19T04:17:40.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2059 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 6819a7f1-1a1d-4a8a-83f5-b82bdccef597 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26572024-10-19T04:17:41.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ebd1b895-4b29-43df-8093-1526ffe4bb06 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26582024-10-19T04:17:41.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ebd1b895-4b29-43df-8093-1526ffe4bb06 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26592024-10-19T04:17:41.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ebd1b895-4b29-43df-8093-1526ffe4bb06 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26602024-10-19T04:17:42.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 27b61692-2358-4fef-8bec-bc141c091f53 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26612024-10-19T04:17:42.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 27b61692-2358-4fef-8bec-bc141c091f53 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26622024-10-19T04:17:42.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2334 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 27b61692-2358-4fef-8bec-bc141c091f53 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26632024-10-19T04:17:43.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d4834663-b011-4d79-a322-53038612c1a7 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26642024-10-19T04:17:43.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d4834663-b011-4d79-a322-53038612c1a7 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26652024-10-19T04:17:43.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d4834663-b011-4d79-a322-53038612c1a7 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26662024-10-19T04:17:44.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 305a4b05-d240-49bc-bce8-2448b7822528 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26672024-10-19T04:17:44.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 305a4b05-d240-49bc-bce8-2448b7822528 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26682024-10-19T04:17:44.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2962 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 305a4b05-d240-49bc-bce8-2448b7822528 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
26692024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
26702024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26712024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
26722024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26732024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26742024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
26752024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
26762024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26772024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
26782024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26792024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
26802024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
26812024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
26822024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
26832024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26842024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
26852024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
26862024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26872024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
26882024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
26892024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
26902024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26912024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26922024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26932024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
26942024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26952024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
26962024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26972024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
26982024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26992024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27002024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
27012024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27022024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27032024-10-19T04:17:44.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27042024-10-19T04:17:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
27052024-10-19T04:17:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27062024-10-19T04:17:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27072024-10-19T04:17:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27082024-10-19T04:17:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27092024-10-19T04:17:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27102024-10-19T04:17:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27112024-10-19T04:17:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27122024-10-19T04:17:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27132024-10-19T04:17:44.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.52163ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
27142024-10-19T04:17:44.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27152024-10-19T04:17:44.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27162024-10-19T04:17:44.862ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8830, tv_nsec: 971387567 } })
27172024-10-19T04:17:44.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27182024-10-19T04:17:44.862ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.55536ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
27192024-10-19T04:17:44.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27202024-10-19T04:17:44.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27212024-10-19T04:17:44.863ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8830, tv_nsec: 972267224 } })
27222024-10-19T04:17:44.863ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
27232024-10-19T04:17:44.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27242024-10-19T04:17:44.863ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
27252024-10-19T04:17:44.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27262024-10-19T04:17:44.863ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
27272024-10-19T04:17:44.863ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
27282024-10-19T04:17:44.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27292024-10-19T04:17:44.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27302024-10-19T04:17:44.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.371836ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27312024-10-19T04:17:44.865ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
27322024-10-19T04:17:44.865ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
27332024-10-19T04:17:44.865ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 6.165501ms iteration = 18 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
27342024-10-19T04:17:44.865ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27352024-10-19T04:17:44.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27362024-10-19T04:17:44.865ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27372024-10-19T04:17:44.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
27382024-10-19T04:17:44.865ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27392024-10-19T04:17:44.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27402024-10-19T04:17:44.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27412024-10-19T04:17:44.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27422024-10-19T04:17:44.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27432024-10-19T04:17:44.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27442024-10-19T04:17:44.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27452024-10-19T04:17:44.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27462024-10-19T04:17:44.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 7.862225ms iteration = 18 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
27472024-10-19T04:17:44.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27482024-10-19T04:17:44.867ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27492024-10-19T04:17:44.867ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27502024-10-19T04:17:44.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27512024-10-19T04:17:44.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27522024-10-19T04:17:44.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27532024-10-19T04:17:44.867ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27542024-10-19T04:17:44.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27552024-10-19T04:17:44.867ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8830, tv_nsec: 977062829 } })
27562024-10-19T04:17:44.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27572024-10-19T04:17:44.868ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
27582024-10-19T04:17:44.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27592024-10-19T04:17:44.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27602024-10-19T04:17:44.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27612024-10-19T04:17:44.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27622024-10-19T04:17:44.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27632024-10-19T04:17:44.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27642024-10-19T04:17:44.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27652024-10-19T04:17:44.869ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27662024-10-19T04:17:44.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27672024-10-19T04:17:44.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27682024-10-19T04:17:44.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27692024-10-19T04:17:44.870ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27702024-10-19T04:17:44.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27712024-10-19T04:17:44.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27722024-10-19T04:17:44.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
27732024-10-19T04:17:44.872ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27742024-10-19T04:17:44.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27752024-10-19T04:17:44.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27762024-10-19T04:17:44.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27772024-10-19T04:17:44.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27782024-10-19T04:17:44.875ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27792024-10-19T04:17:44.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27802024-10-19T04:17:44.875ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
27812024-10-19T04:17:44.875ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 16.333472ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
27822024-10-19T04:17:44.878ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
27832024-10-19T04:17:44.878ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 19.148097ms iteration = 21 status = {"physical_disks_added":0}
27842024-10-19T04:17:44.878ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.180448ms iteration = 52 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
27852024-10-19T04:17:44.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27862024-10-19T04:17:44.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27872024-10-19T04:17:44.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27882024-10-19T04:17:44.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27892024-10-19T04:17:44.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27902024-10-19T04:17:44.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27912024-10-19T04:17:44.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27922024-10-19T04:17:44.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27932024-10-19T04:17:44.886ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27942024-10-19T04:17:44.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27952024-10-19T04:17:44.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27962024-10-19T04:17:44.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8180ea00-0a5e-4377-b19a-82e7e60b09bd, lookup_type: ById(8180ea00-0a5e-4377-b19a-82e7e60b09bd) } result = Ok(())
27972024-10-19T04:17:44.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27982024-10-19T04:17:44.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27992024-10-19T04:17:44.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28002024-10-19T04:17:44.888ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 29.353628ms iteration = 18 status = 0
28012024-10-19T04:17:44.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28022024-10-19T04:17:44.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28032024-10-19T04:17:44.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28042024-10-19T04:17:44.896ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 37.265763ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
28052024-10-19T04:17:44.991ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
28062024-10-19T04:17:44.991ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28072024-10-19T04:17:44.991ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b6f94ed4-2903-4bd6-b2a2-5366a4ad825f", "content-length": "26", "date": "Sat, 19 Oct 2024 04:17:44 GMT"} })
28082024-10-19T04:17:44.991ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28092024-10-19T04:17:44.994ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28102024-10-19T04:17:45.001ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
28112024-10-19T04:17:45.001ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28122024-10-19T04:17:45.001ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "98d2266c-9f56-4cd8-afe5-e9d40e0e4ae9", "content-length": "26", "date": "Sat, 19 Oct 2024 04:17:44 GMT"} })
28132024-10-19T04:17:45.001ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28142024-10-19T04:17:45.003ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28152024-10-19T04:17:45.011ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28162024-10-19T04:17:45.011ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "affa7f1c-9d48-4c8f-a6d1-5a89fd16ac7d", "content-length": "372", "date": "Sat, 19 Oct 2024 04:17:45 GMT"} })
28172024-10-19T04:17:45.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28182024-10-19T04:17:45.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28192024-10-19T04:17:45.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28202024-10-19T04:17:45.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28212024-10-19T04:17:45.016ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28222024-10-19T04:17:45.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28232024-10-19T04:17:45.018ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28242024-10-19T04:17:45.019ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b3adb276-2cc5-41eb-a8dd-f6a353c44083", "date": "Sat, 19 Oct 2024 04:17:45 GMT"} })
28252024-10-19T04:17:45.020ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 161.594773ms iteration = 20 status = {}
28262024-10-19T04:17:45.099ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 zone_address = fd00:1122:3344:101::2
28272024-10-19T04:17:45.099ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28282024-10-19T04:17:45.099ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bcc0eb77-e8e7-47d0-8cdb-41527adeedac", "content-length": "26", "date": "Sat, 19 Oct 2024 04:17:44 GMT"} })
28292024-10-19T04:17:45.099ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28302024-10-19T04:17:45.100ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
28312024-10-19T04:17:45.101ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
28322024-10-19T04:17:45.101ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b7e4a32e-29d1-49b5-b923-fc7f64fb4828", "content-length": "2", "date": "Sat, 19 Oct 2024 04:17:44 GMT"} })
28332024-10-19T04:17:45.104ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28342024-10-19T04:17:45.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28352024-10-19T04:17:45.105ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 246.466615ms iteration = 18 status = null
28362024-10-19T04:17:45.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = fcc0fb3d-b366-48ac-a95d-815116082dbf roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
28372024-10-19T04:17:45.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = fcc0fb3d-b366-48ac-a95d-815116082dbf resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
28382024-10-19T04:17:45.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = fcc0fb3d-b366-48ac-a95d-815116082dbf response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
28392024-10-19T04:17:45.109ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 249.968293ms iteration = 18 status = {}
28402024-10-19T04:17:45.117ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
28412024-10-19T04:17:45.118ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "92a523ee-592c-4425-bad2-c75cf4b62d01", "content-length": "691", "date": "Sat, 19 Oct 2024 04:17:45 GMT"} })
28422024-10-19T04:17:45.118ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
28432024-10-19T04:17:45.118ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
28442024-10-19T04:17:45.118ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
28452024-10-19T04:17:45.119ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 260.350768ms iteration = 19 status = {}
28462024-10-19T04:17:45.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28472024-10-19T04:17:45.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28482024-10-19T04:17:45.206ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 67c66fb2-5b53-4f7b-be0b-63b92427bb54, rack_id: 7a4ab4db-4586-4060-be07-8fb242636fc1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ce7dad06-a40f-46ae-96ea-31487ccc19ce) } rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0
28492024-10-19T04:17:45.206ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28502024-10-19T04:17:45.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28512024-10-19T04:17:45.214ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
28522024-10-19T04:17:45.214ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8576e2d2-fd9e-4eab-8edd-db3d3d0c4809", "content-length": "121", "date": "Sat, 19 Oct 2024 04:17:44 GMT"} })
28532024-10-19T04:17:45.214ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
28542024-10-19T04:17:45.214ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ce7dad06-a40f-46ae-96ea-31487ccc19ce
28552024-10-19T04:17:45.215ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
28562024-10-19T04:17:45.215ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
28572024-10-19T04:17:45.215ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {}
28582024-10-19T04:17:45.215ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {}
28592024-10-19T04:17:45.215ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
28602024-10-19T04:17:45.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28612024-10-19T04:17:45.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28622024-10-19T04:17:45.216ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
28632024-10-19T04:17:45.217ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d4144904-7399-4388-857c-a7e21697dfb7", "content-length": "2", "date": "Sat, 19 Oct 2024 04:17:44 GMT"} })
28642024-10-19T04:17:45.217ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
28652024-10-19T04:17:45.217ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dae2c615-f210-4e61-998f-5119ff798668", "content-length": "52", "date": "Sat, 19 Oct 2024 04:17:44 GMT"} })
28662024-10-19T04:17:45.217ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0
28672024-10-19T04:17:45.217ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
28682024-10-19T04:17:45.311ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ad4316a8-e0af-4183-8048-74e2370824e6", "date": "Sat, 19 Oct 2024 04:17:45 GMT"} })
28692024-10-19T04:17:45.311ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch = Switch0
28702024-10-19T04:17:45.311ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
28712024-10-19T04:17:45.312ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0510b3fc-c83c-47e3-b52c-6a73eb776776", "content-length": "667", "date": "Sat, 19 Oct 2024 04:17:45 GMT"} })
28722024-10-19T04:17:45.312ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28732024-10-19T04:17:45.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28742024-10-19T04:17:45.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28752024-10-19T04:17:45.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28762024-10-19T04:17:45.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28772024-10-19T04:17:45.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28782024-10-19T04:17:45.319ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28792024-10-19T04:17:45.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28802024-10-19T04:17:45.326ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 467.358506ms iteration = 18 status = {}
28812024-10-19T04:17:46.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = acc2eb05-21ef-4a37-9e2e-98999be34927 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
28822024-10-19T04:17:46.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = acc2eb05-21ef-4a37-9e2e-98999be34927 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
28832024-10-19T04:17:46.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = acc2eb05-21ef-4a37-9e2e-98999be34927 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
28842024-10-19T04:17:46.975ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = 7964f489-bff8-49b6-bb10-8003b8bbe52a response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
28852024-10-19T04:17:47.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 04165532-7278-4072-ae0a-a061f2685095 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
28862024-10-19T04:17:47.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 04165532-7278-4072-ae0a-a061f2685095 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
28872024-10-19T04:17:47.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2618 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 04165532-7278-4072-ae0a-a061f2685095 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
28882024-10-19T04:17:48.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5059d4a2-ffff-4940-9e1b-aaac5c70d78f roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
28892024-10-19T04:17:48.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5059d4a2-ffff-4940-9e1b-aaac5c70d78f resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
28902024-10-19T04:17:48.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2845 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5059d4a2-ffff-4940-9e1b-aaac5c70d78f response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
28912024-10-19T04:17:49.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1b00a943-7ff2-462a-b68b-07d909faa2c3 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
28922024-10-19T04:17:49.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1b00a943-7ff2-462a-b68b-07d909faa2c3 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
28932024-10-19T04:17:49.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1b00a943-7ff2-462a-b68b-07d909faa2c3 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
28942024-10-19T04:17:50.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ceb8be48-a43f-4e46-84bc-751253fd685a roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
28952024-10-19T04:17:50.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ceb8be48-a43f-4e46-84bc-751253fd685a resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
28962024-10-19T04:17:50.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2079 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ceb8be48-a43f-4e46-84bc-751253fd685a response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
28972024-10-19T04:17:51.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = c60488a7-1a2c-418f-8daa-44a2c6664fb3 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
28982024-10-19T04:17:51.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = c60488a7-1a2c-418f-8daa-44a2c6664fb3 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
28992024-10-19T04:17:51.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = c60488a7-1a2c-418f-8daa-44a2c6664fb3 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29002024-10-19T04:17:52.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 99a5b559-5fa3-4389-9ab7-ed6c88908ca6 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29012024-10-19T04:17:52.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 99a5b559-5fa3-4389-9ab7-ed6c88908ca6 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29022024-10-19T04:17:52.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 99a5b559-5fa3-4389-9ab7-ed6c88908ca6 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29032024-10-19T04:17:53.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 128a93cf-c193-4acb-b372-e4b436810063 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29042024-10-19T04:17:53.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 128a93cf-c193-4acb-b372-e4b436810063 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29052024-10-19T04:17:53.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 128a93cf-c193-4acb-b372-e4b436810063 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29062024-10-19T04:17:54.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 73d75cb0-2cf6-45c5-83b2-9d720d52c828 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29072024-10-19T04:17:54.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 73d75cb0-2cf6-45c5-83b2-9d720d52c828 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29082024-10-19T04:17:54.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2375 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 73d75cb0-2cf6-45c5-83b2-9d720d52c828 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29092024-10-19T04:17:54.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
29102024-10-19T04:17:54.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
29112024-10-19T04:17:54.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29122024-10-19T04:17:54.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29132024-10-19T04:17:54.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29142024-10-19T04:17:54.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29152024-10-19T04:17:54.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29162024-10-19T04:17:54.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29172024-10-19T04:17:54.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29182024-10-19T04:17:54.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.858036ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29192024-10-19T04:17:54.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29202024-10-19T04:17:54.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29212024-10-19T04:17:54.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29222024-10-19T04:17:54.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29232024-10-19T04:17:54.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29242024-10-19T04:17:54.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29252024-10-19T04:17:54.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
29262024-10-19T04:17:54.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29272024-10-19T04:17:54.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29282024-10-19T04:17:54.874ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
29292024-10-19T04:17:54.874ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.358172ms iteration = 53 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
29302024-10-19T04:17:55.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = bf7ea34f-0664-489a-ae6a-68882cad2231 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29312024-10-19T04:17:55.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = bf7ea34f-0664-489a-ae6a-68882cad2231 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29322024-10-19T04:17:55.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2750 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = bf7ea34f-0664-489a-ae6a-68882cad2231 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29332024-10-19T04:17:56.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0b8d519c-b6f4-45ec-b713-73bc1df63278 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29342024-10-19T04:17:56.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0b8d519c-b6f4-45ec-b713-73bc1df63278 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29352024-10-19T04:17:56.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0b8d519c-b6f4-45ec-b713-73bc1df63278 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29362024-10-19T04:17:56.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = a37455e6-7064-4d36-b735-1774dff705fd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
29372024-10-19T04:17:56.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = a37455e6-7064-4d36-b735-1774dff705fd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
29382024-10-19T04:17:56.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3522 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = a37455e6-7064-4d36-b735-1774dff705fd response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
29392024-10-19T04:17:56.974ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1538 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = c4e4f01a-b106-468d-bce4-7cf6b5ff399e response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
29402024-10-19T04:17:57.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = da193de7-a95b-43f0-937d-af9624657855 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29412024-10-19T04:17:57.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = da193de7-a95b-43f0-937d-af9624657855 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29422024-10-19T04:17:57.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2348 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = da193de7-a95b-43f0-937d-af9624657855 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29432024-10-19T04:17:58.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 36393689-9f20-4da2-adbb-a1809a2cad91 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29442024-10-19T04:17:58.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 36393689-9f20-4da2-adbb-a1809a2cad91 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29452024-10-19T04:17:58.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 36393689-9f20-4da2-adbb-a1809a2cad91 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29462024-10-19T04:17:59.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4e38bac6-9a82-417b-8363-6cb9668dd00e roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29472024-10-19T04:17:59.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4e38bac6-9a82-417b-8363-6cb9668dd00e resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29482024-10-19T04:17:59.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2796 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4e38bac6-9a82-417b-8363-6cb9668dd00e response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29492024-10-19T04:18:00.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 995f1080-e913-4e07-95d8-e43579d26001 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29502024-10-19T04:18:00.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 995f1080-e913-4e07-95d8-e43579d26001 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29512024-10-19T04:18:00.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2388 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 995f1080-e913-4e07-95d8-e43579d26001 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29522024-10-19T04:18:01.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e0046451-9e23-45bd-9bd7-3d4ce33cc377 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29532024-10-19T04:18:01.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e0046451-9e23-45bd-9bd7-3d4ce33cc377 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29542024-10-19T04:18:01.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2969 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e0046451-9e23-45bd-9bd7-3d4ce33cc377 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29552024-10-19T04:18:02.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9c0c879c-c00e-467b-a50d-481049bed63d roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29562024-10-19T04:18:02.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9c0c879c-c00e-467b-a50d-481049bed63d resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29572024-10-19T04:18:02.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2714 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9c0c879c-c00e-467b-a50d-481049bed63d response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29582024-10-19T04:18:03.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 56aae4a3-1549-44d7-9738-83ca0906bcc3 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29592024-10-19T04:18:03.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 56aae4a3-1549-44d7-9738-83ca0906bcc3 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29602024-10-19T04:18:03.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 56aae4a3-1549-44d7-9738-83ca0906bcc3 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29612024-10-19T04:18:04.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = b1a62380-a3ec-4016-931a-490ff8661218 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29622024-10-19T04:18:04.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = b1a62380-a3ec-4016-931a-490ff8661218 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29632024-10-19T04:18:04.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2701 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = b1a62380-a3ec-4016-931a-490ff8661218 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29642024-10-19T04:18:04.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
29652024-10-19T04:18:04.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
29662024-10-19T04:18:04.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29672024-10-19T04:18:04.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29682024-10-19T04:18:04.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29692024-10-19T04:18:04.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29702024-10-19T04:18:04.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29712024-10-19T04:18:04.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29722024-10-19T04:18:04.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29732024-10-19T04:18:04.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.826215ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29742024-10-19T04:18:04.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29752024-10-19T04:18:04.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29762024-10-19T04:18:04.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29772024-10-19T04:18:04.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29782024-10-19T04:18:04.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29792024-10-19T04:18:04.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29802024-10-19T04:18:04.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
29812024-10-19T04:18:04.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29822024-10-19T04:18:04.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29832024-10-19T04:18:04.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
29842024-10-19T04:18:04.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.134098ms iteration = 54 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
29852024-10-19T04:18:05.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 95a8f301-2928-4443-acd4-fbc4b9eb030f roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29862024-10-19T04:18:05.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 95a8f301-2928-4443-acd4-fbc4b9eb030f resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29872024-10-19T04:18:05.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1869 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 95a8f301-2928-4443-acd4-fbc4b9eb030f response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29882024-10-19T04:18:06.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 56699120-84d1-423e-82cc-6145c83373bd roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29892024-10-19T04:18:06.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 56699120-84d1-423e-82cc-6145c83373bd resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29902024-10-19T04:18:06.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 56699120-84d1-423e-82cc-6145c83373bd response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29912024-10-19T04:18:06.975ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2557 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = 2e2614a9-51cf-4074-a4cb-ee6dc1bc4ded response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
29922024-10-19T04:18:07.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = dd062a6f-798a-4a94-9c7d-3f9b4f481e8d roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29932024-10-19T04:18:07.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = dd062a6f-798a-4a94-9c7d-3f9b4f481e8d resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29942024-10-19T04:18:07.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = dd062a6f-798a-4a94-9c7d-3f9b4f481e8d response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29952024-10-19T04:18:08.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = bd72ee39-803c-4415-98ed-a5875b53b1fa roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29962024-10-19T04:18:08.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = bd72ee39-803c-4415-98ed-a5875b53b1fa resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29972024-10-19T04:18:08.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = bd72ee39-803c-4415-98ed-a5875b53b1fa response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29982024-10-19T04:18:09.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 005b8eb8-6f03-403e-ad6a-c491d89fdf9d roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
29992024-10-19T04:18:09.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 005b8eb8-6f03-403e-ad6a-c491d89fdf9d resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
30002024-10-19T04:18:09.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 005b8eb8-6f03-403e-ad6a-c491d89fdf9d response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
30012024-10-19T04:18:10.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 68820422-109e-4135-9671-711a0078e8ed roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
30022024-10-19T04:18:10.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 68820422-109e-4135-9671-711a0078e8ed resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
30032024-10-19T04:18:10.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2690 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 68820422-109e-4135-9671-711a0078e8ed response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
30042024-10-19T04:18:11.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7502d8dc-ad93-412b-a791-3d5c7654ed36 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
30052024-10-19T04:18:11.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7502d8dc-ad93-412b-a791-3d5c7654ed36 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
30062024-10-19T04:18:11.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1955 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 7502d8dc-ad93-412b-a791-3d5c7654ed36 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
30072024-10-19T04:18:12.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0d4f10b8-e844-4232-9c88-b9b20a165500 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
30082024-10-19T04:18:12.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0d4f10b8-e844-4232-9c88-b9b20a165500 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
30092024-10-19T04:18:12.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0d4f10b8-e844-4232-9c88-b9b20a165500 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
30102024-10-19T04:18:13.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3bb88d32-11eb-49c3-8b45-5bb76722d9e7 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
30112024-10-19T04:18:13.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3bb88d32-11eb-49c3-8b45-5bb76722d9e7 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
30122024-10-19T04:18:13.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3bb88d32-11eb-49c3-8b45-5bb76722d9e7 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
30132024-10-19T04:18:14.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 30f7cf3d-e2b7-4588-960f-9a45fa722e8c roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
30142024-10-19T04:18:14.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 30f7cf3d-e2b7-4588-960f-9a45fa722e8c resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
30152024-10-19T04:18:14.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2438 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 30f7cf3d-e2b7-4588-960f-9a45fa722e8c response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
30162024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
30172024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
30182024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
30192024-10-19T04:18:14.859ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931
30202024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30212024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.361\u{b5}s iteration = 11 status = {"error":"blueprint disabled","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931"}
30222024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
30232024-10-19T04:18:14.859ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
30242024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
30252024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
30262024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30272024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
30282024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
30292024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30302024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
30312024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
30322024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30332024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
30342024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
30352024-10-19T04:18:14.859ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-19 04:08:14.859630014 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
30362024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
30372024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
30382024-10-19T04:18:14.859ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
30392024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
30402024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
30412024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
30422024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30432024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
30442024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30452024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
30462024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
30472024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30482024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
30492024-10-19T04:18:14.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30502024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
30512024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
30522024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30532024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
30542024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30552024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
30562024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30572024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
30582024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30592024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
30602024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
30612024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
30622024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
30632024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
30642024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
30652024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30662024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
30672024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30682024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30692024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
30702024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30712024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
30722024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30732024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
30742024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30752024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30762024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
30772024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
30782024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
30792024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30802024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30812024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30822024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30832024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30842024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30852024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30862024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
30872024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
30882024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30892024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30902024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30912024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30922024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30932024-10-19T04:18:14.860ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("077283a3-2f69-419e-8ab2-1088c51300c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f0b5b4d-c580-4418-9bbc-5d1b6d257b94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a79265b8-3f31-40c4-bdbb-3f2463bd3c30.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a79265b8-3f31-40c4-bdbb-3f2463bd3c30.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 8860, tv_nsec: 969939748 } })
30942024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30952024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30962024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30972024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30982024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30992024-10-19T04:18:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31002024-10-19T04:18:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31012024-10-19T04:18:14.861ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31022024-10-19T04:18:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31032024-10-19T04:18:14.861ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31042024-10-19T04:18:14.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31052024-10-19T04:18:14.862ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3881ebd6-060e-4a3f-8035-5fd76566e5d0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4ba9b73a-0f82-489d-a9fb-902be604440b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("4ba9b73a-0f82-489d-a9fb-902be604440b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 8860, tv_nsec: 971292115 } })
31062024-10-19T04:18:14.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31072024-10-19T04:18:14.862ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31082024-10-19T04:18:14.862ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31092024-10-19T04:18:14.862ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31102024-10-19T04:18:14.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31112024-10-19T04:18:14.863ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.223933ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
31122024-10-19T04:18:14.863ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-19 04:08:14.859630014 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
31132024-10-19T04:18:14.863ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.810995ms iteration = 10 status = {"expiration":"2024-10-19T04:08:14.859630014Z","pruned":[]}
31142024-10-19T04:18:14.863ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
31152024-10-19T04:18:14.863ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
31162024-10-19T04:18:14.863ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 3.888736ms iteration = 10 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
31172024-10-19T04:18:14.863ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31182024-10-19T04:18:14.863ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
31192024-10-19T04:18:14.863ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.145862ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
31202024-10-19T04:18:14.863ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
31212024-10-19T04:18:14.863ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.906167ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
31222024-10-19T04:18:14.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31232024-10-19T04:18:14.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.374236ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
31242024-10-19T04:18:14.864ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
31252024-10-19T04:18:14.864ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
31262024-10-19T04:18:14.864ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31272024-10-19T04:18:14.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31282024-10-19T04:18:14.865ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31292024-10-19T04:18:14.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31302024-10-19T04:18:14.865ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8860, tv_nsec: 974470107 } })
31312024-10-19T04:18:14.865ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
31322024-10-19T04:18:14.866ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31332024-10-19T04:18:14.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
31342024-10-19T04:18:14.866ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31352024-10-19T04:18:14.866ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
31362024-10-19T04:18:14.866ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
31372024-10-19T04:18:14.866ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 6.729992ms iteration = 19 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
31382024-10-19T04:18:14.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
31392024-10-19T04:18:14.866ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31402024-10-19T04:18:14.866ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8860, tv_nsec: 975731332 } })
31412024-10-19T04:18:14.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31422024-10-19T04:18:14.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31432024-10-19T04:18:14.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31442024-10-19T04:18:14.866ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
31452024-10-19T04:18:14.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
31462024-10-19T04:18:14.867ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31472024-10-19T04:18:14.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
31482024-10-19T04:18:14.867ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
31492024-10-19T04:18:14.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31502024-10-19T04:18:14.867ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31512024-10-19T04:18:14.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31522024-10-19T04:18:14.868ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31532024-10-19T04:18:14.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31542024-10-19T04:18:14.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31552024-10-19T04:18:14.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31562024-10-19T04:18:14.868ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31572024-10-19T04:18:14.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 9.303364ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31582024-10-19T04:18:14.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31592024-10-19T04:18:14.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31602024-10-19T04:18:14.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31612024-10-19T04:18:14.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31622024-10-19T04:18:14.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
31632024-10-19T04:18:14.871ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31642024-10-19T04:18:14.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31652024-10-19T04:18:14.871ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31662024-10-19T04:18:14.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31672024-10-19T04:18:14.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31682024-10-19T04:18:14.873ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.139988ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
31692024-10-19T04:18:14.873ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
31702024-10-19T04:18:14.873ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
31712024-10-19T04:18:14.873ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
31722024-10-19T04:18:14.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31732024-10-19T04:18:14.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
31742024-10-19T04:18:14.874ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31752024-10-19T04:18:14.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31762024-10-19T04:18:14.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31772024-10-19T04:18:14.874ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31782024-10-19T04:18:14.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31792024-10-19T04:18:14.874ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
31802024-10-19T04:18:14.874ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
31812024-10-19T04:18:14.874ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 15.309091ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
31822024-10-19T04:18:14.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31832024-10-19T04:18:14.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31842024-10-19T04:18:14.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31852024-10-19T04:18:14.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31862024-10-19T04:18:14.876ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8860, tv_nsec: 985686198 } })
31872024-10-19T04:18:14.877ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
31882024-10-19T04:18:14.877ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31892024-10-19T04:18:14.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31902024-10-19T04:18:14.877ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31912024-10-19T04:18:14.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
31922024-10-19T04:18:14.877ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31932024-10-19T04:18:14.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31942024-10-19T04:18:14.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31952024-10-19T04:18:14.878ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31962024-10-19T04:18:14.878ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31972024-10-19T04:18:14.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31982024-10-19T04:18:14.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31992024-10-19T04:18:14.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32002024-10-19T04:18:14.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32012024-10-19T04:18:14.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32022024-10-19T04:18:14.880ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32032024-10-19T04:18:14.880ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32042024-10-19T04:18:14.880ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 20.763219ms iteration = 19 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
32052024-10-19T04:18:14.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
32062024-10-19T04:18:14.880ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32072024-10-19T04:18:14.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32082024-10-19T04:18:14.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32092024-10-19T04:18:14.881ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32102024-10-19T04:18:14.881ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 22.093235ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
32112024-10-19T04:18:14.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32122024-10-19T04:18:14.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32132024-10-19T04:18:14.882ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32142024-10-19T04:18:14.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32152024-10-19T04:18:14.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
32162024-10-19T04:18:14.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32172024-10-19T04:18:14.882ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32182024-10-19T04:18:14.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32192024-10-19T04:18:14.883ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
32202024-10-19T04:18:14.883ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = fb44ee4c-c5ec-4992-abdf-b6f7e2fadda5 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
32212024-10-19T04:18:14.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32222024-10-19T04:18:14.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32232024-10-19T04:18:14.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32242024-10-19T04:18:14.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
32252024-10-19T04:18:14.883ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32262024-10-19T04:18:14.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32272024-10-19T04:18:14.884ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
32282024-10-19T04:18:14.884ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
32292024-10-19T04:18:14.884ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
32302024-10-19T04:18:14.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32312024-10-19T04:18:14.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32322024-10-19T04:18:14.884ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32332024-10-19T04:18:14.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32342024-10-19T04:18:14.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32352024-10-19T04:18:14.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32362024-10-19T04:18:14.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32372024-10-19T04:18:14.885ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 26.216117ms iteration = 5 status = {"nsuccess":5}
32382024-10-19T04:18:14.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32392024-10-19T04:18:14.886ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32402024-10-19T04:18:14.886ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32412024-10-19T04:18:14.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32422024-10-19T04:18:14.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
32432024-10-19T04:18:14.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32442024-10-19T04:18:14.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32452024-10-19T04:18:14.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32462024-10-19T04:18:14.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32472024-10-19T04:18:14.888ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
32482024-10-19T04:18:14.888ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 28.542092ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
32492024-10-19T04:18:14.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
32502024-10-19T04:18:14.888ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32512024-10-19T04:18:14.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32522024-10-19T04:18:14.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32532024-10-19T04:18:14.889ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32542024-10-19T04:18:14.889ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
32552024-10-19T04:18:14.889ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.479201ms iteration = 55 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
32562024-10-19T04:18:14.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32572024-10-19T04:18:14.889ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32582024-10-19T04:18:14.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32592024-10-19T04:18:14.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32602024-10-19T04:18:14.890ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32612024-10-19T04:18:14.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32622024-10-19T04:18:14.890ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32632024-10-19T04:18:14.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32642024-10-19T04:18:14.891ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
32652024-10-19T04:18:14.891ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a4077ac0-652e-4998-9c99-e66a22abccb6 dns_zone_name = oxide.test found_so_far = 0 version = 2
32662024-10-19T04:18:14.891ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32672024-10-19T04:18:14.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32682024-10-19T04:18:14.891ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = fb44ee4c-c5ec-4992-abdf-b6f7e2fadda5 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
32692024-10-19T04:18:14.891ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
32702024-10-19T04:18:14.891ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-19 04:10:05.441343 UTC dns_group = internal generation = 1
32712024-10-19T04:18:14.891ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 32.133103ms iteration = 11 status = {"generation":1}
32722024-10-19T04:18:14.891ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32732024-10-19T04:18:14.892ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32742024-10-19T04:18:14.892ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 32.728065ms iteration = 22 status = {"physical_disks_added":0}
32752024-10-19T04:18:14.892ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32762024-10-19T04:18:14.894ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32772024-10-19T04:18:14.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32782024-10-19T04:18:14.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32792024-10-19T04:18:14.894ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32802024-10-19T04:18:14.894ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32812024-10-19T04:18:14.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32822024-10-19T04:18:14.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32832024-10-19T04:18:14.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32842024-10-19T04:18:14.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32852024-10-19T04:18:14.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32862024-10-19T04:18:14.897ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a4077ac0-652e-4998-9c99-e66a22abccb6 dns_zone_name = oxide.test found_so_far = 1 version = 2
32872024-10-19T04:18:14.897ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
32882024-10-19T04:18:14.897ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-19 04:10:05.874167 UTC dns_group = external generation = 2
32892024-10-19T04:18:14.897ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 37.607371ms iteration = 11 status = {"generation":2}
32902024-10-19T04:18:14.897ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32912024-10-19T04:18:14.897ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32922024-10-19T04:18:14.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32932024-10-19T04:18:14.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32942024-10-19T04:18:14.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32952024-10-19T04:18:14.902ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32962024-10-19T04:18:14.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32972024-10-19T04:18:14.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32982024-10-19T04:18:14.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8180ea00-0a5e-4377-b19a-82e7e60b09bd, lookup_type: ById(8180ea00-0a5e-4377-b19a-82e7e60b09bd) } result = Ok(())
32992024-10-19T04:18:14.906ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33002024-10-19T04:18:14.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33012024-10-19T04:18:14.907ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 47.424224ms iteration = 19 status = 0
33022024-10-19T04:18:14.931ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-19T04:09:14.003740Z, time_modified: 2024-10-19T04:09:14.003740Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, db_silo: Silo { identity: SiloIdentity { id: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-19T04:10:05.838166Z, time_modified: 2024-10-19T04:10:05.838166Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1f4033bd55b23e094b1263660016971c2c68cc6162a83dcd709c701bd968e3c5" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, db_silo: Silo { identity: SiloIdentity { id: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-19T04:10:05.838166Z, time_modified: 2024-10-19T04:10:05.838166Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1f4033bd55b23e094b1263660016971c2c68cc6162a83dcd709c701bd968e3c5" }] }) }
33032024-10-19T04:18:14.931ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 71.973288ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"54ab3538-1bb1-4d5e-a518-5d0dec26f2d7","tls_certs":["1f4033bd55b23e094b1263660016971c2c68cc6162a83dcd709c701bd968e3c5"]}},"default_endpoint":{"silo_id":"54ab3538-1bb1-4d5e-a518-5d0dec26f2d7","tls_certs":["1f4033bd55b23e094b1263660016971c2c68cc6162a83dcd709c701bd968e3c5"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
33042024-10-19T04:18:15.046ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
33052024-10-19T04:18:15.046ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
33062024-10-19T04:18:15.058ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33072024-10-19T04:18:15.058ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "93e9d302-9fb9-4af0-8892-3723666532df", "content-length": "372", "date": "Sat, 19 Oct 2024 04:18:15 GMT"} })
33082024-10-19T04:18:15.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33092024-10-19T04:18:15.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33102024-10-19T04:18:15.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33112024-10-19T04:18:15.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33122024-10-19T04:18:15.063ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33132024-10-19T04:18:15.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33142024-10-19T04:18:15.066ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33152024-10-19T04:18:15.067ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6546383f-c7c8-473c-9a3d-1d01e2d2b16b", "date": "Sat, 19 Oct 2024 04:18:15 GMT"} })
33162024-10-19T04:18:15.069ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 209.308923ms iteration = 21 status = {}
33172024-10-19T04:18:15.082ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 zone_address = fd00:1122:3344:101::2
33182024-10-19T04:18:15.082ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33192024-10-19T04:18:15.082ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a672c97d-c2a2-4a43-a5c4-d0dbcc9b3d6a", "content-length": "26", "date": "Sat, 19 Oct 2024 04:18:15 GMT"} })
33202024-10-19T04:18:15.082ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33212024-10-19T04:18:15.084ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
33222024-10-19T04:18:15.110ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
33232024-10-19T04:18:15.110ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e9100abb-888e-467b-b7ec-93ba437de6c1", "content-length": "691", "date": "Sat, 19 Oct 2024 04:18:15 GMT"} })
33242024-10-19T04:18:15.110ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
33252024-10-19T04:18:15.110ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
33262024-10-19T04:18:15.110ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
33272024-10-19T04:18:15.112ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 253.037105ms iteration = 20 status = {}
33282024-10-19T04:18:15.171ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
33292024-10-19T04:18:15.171ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33302024-10-19T04:18:15.172ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c5295332-c6e2-4527-a0ef-a6ba5dedb3ad", "content-length": "26", "date": "Sat, 19 Oct 2024 04:18:15 GMT"} })
33312024-10-19T04:18:15.172ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33322024-10-19T04:18:15.175ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33332024-10-19T04:18:15.183ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
33342024-10-19T04:18:15.183ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33352024-10-19T04:18:15.184ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f1bb9476-4c81-463e-8d13-ec0c5d83086e", "content-length": "26", "date": "Sat, 19 Oct 2024 04:18:15 GMT"} })
33362024-10-19T04:18:15.184ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33372024-10-19T04:18:15.185ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33382024-10-19T04:18:15.202ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
33392024-10-19T04:18:15.203ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4d337cec-5f5b-4b26-bcb4-182a6363f719", "date": "Sat, 19 Oct 2024 04:18:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33402024-10-19T04:18:15.203ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33412024-10-19T04:18:15.205ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
33422024-10-19T04:18:15.205ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8724864d-53f2-4765-bf83-9d1504b56ec0", "date": "Sat, 19 Oct 2024 04:18:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33432024-10-19T04:18:15.205ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33442024-10-19T04:18:15.207ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33452024-10-19T04:18:15.207ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 347.72379ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
33462024-10-19T04:18:15.285ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 425.730256ms iteration = 19 status = {}
33472024-10-19T04:18:15.290ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
33482024-10-19T04:18:15.290ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "eb3c4f2a-7a5d-4fa9-b4c8-ffd466daf75c", "content-length": "2", "date": "Sat, 19 Oct 2024 04:18:14 GMT"} })
33492024-10-19T04:18:15.292ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33502024-10-19T04:18:15.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33512024-10-19T04:18:15.294ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 434.767704ms iteration = 19 status = null
33522024-10-19T04:18:15.300ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
33532024-10-19T04:18:15.301ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d4d3758a-23ec-40b4-9a80-083e89668cbd", "date": "Sat, 19 Oct 2024 04:18:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
33542024-10-19T04:18:15.301ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
33552024-10-19T04:18:15.303ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7af01d9b-bcb5-4d5d-a11c-0371436c853f", "date": "Sat, 19 Oct 2024 04:18:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
33562024-10-19T04:18:15.303ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
33572024-10-19T04:18:15.305ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "81f36fec-2bf5-45c9-a875-dd002cda1499", "date": "Sat, 19 Oct 2024 04:18:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
33582024-10-19T04:18:15.305ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
33592024-10-19T04:18:15.306ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
33602024-10-19T04:18:15.306ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 446.602137ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
33612024-10-19T04:18:15.354ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33622024-10-19T04:18:15.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33632024-10-19T04:18:15.355ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 67c66fb2-5b53-4f7b-be0b-63b92427bb54, rack_id: 7a4ab4db-4586-4060-be07-8fb242636fc1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ce7dad06-a40f-46ae-96ea-31487ccc19ce) } rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0
33642024-10-19T04:18:15.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33652024-10-19T04:18:15.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33662024-10-19T04:18:15.362ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
33672024-10-19T04:18:15.363ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b1888bc9-8f03-4b54-9917-c9cc959c8f7a", "content-length": "121", "date": "Sat, 19 Oct 2024 04:18:14 GMT"} })
33682024-10-19T04:18:15.363ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
33692024-10-19T04:18:15.363ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ce7dad06-a40f-46ae-96ea-31487ccc19ce
33702024-10-19T04:18:15.363ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33712024-10-19T04:18:15.363ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33722024-10-19T04:18:15.363ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {}
33732024-10-19T04:18:15.363ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {}
33742024-10-19T04:18:15.363ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
33752024-10-19T04:18:15.363ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33762024-10-19T04:18:15.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33772024-10-19T04:18:15.364ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
33782024-10-19T04:18:15.365ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4c39c0cf-4373-4621-8e0d-e61c2f805b12", "content-length": "2", "date": "Sat, 19 Oct 2024 04:18:14 GMT"} })
33792024-10-19T04:18:15.365ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
33802024-10-19T04:18:15.365ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "38c37652-a8ca-4d79-b640-d03ee06c4a9d", "content-length": "52", "date": "Sat, 19 Oct 2024 04:18:14 GMT"} })
33812024-10-19T04:18:15.365ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0
33822024-10-19T04:18:15.365ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
33832024-10-19T04:18:15.465ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7cb517d2-10f0-4744-bf1f-75dd444ee965", "date": "Sat, 19 Oct 2024 04:18:15 GMT"} })
33842024-10-19T04:18:15.465ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch = Switch0
33852024-10-19T04:18:15.465ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
33862024-10-19T04:18:15.466ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2e8776ef-b30a-4b0b-9f71-d22b984b9c77", "content-length": "667", "date": "Sat, 19 Oct 2024 04:18:15 GMT"} })
33872024-10-19T04:18:15.466ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33882024-10-19T04:18:15.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33892024-10-19T04:18:15.470ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33902024-10-19T04:18:15.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33912024-10-19T04:18:15.473ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33922024-10-19T04:18:15.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33932024-10-19T04:18:15.474ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33942024-10-19T04:18:15.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33952024-10-19T04:18:15.481ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 621.285258ms iteration = 19 status = {}
33962024-10-19T04:18:15.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1a94b255-1d72-469b-a4c5-cdc2cc44083a roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
33972024-10-19T04:18:15.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1a94b255-1d72-469b-a4c5-cdc2cc44083a resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
33982024-10-19T04:18:15.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1966 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1a94b255-1d72-469b-a4c5-cdc2cc44083a response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
33992024-10-19T04:18:16.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 71e33734-10ea-4b49-8485-91257fdd28cb roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34002024-10-19T04:18:16.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 71e33734-10ea-4b49-8485-91257fdd28cb resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34012024-10-19T04:18:16.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 71e33734-10ea-4b49-8485-91257fdd28cb response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34022024-10-19T04:18:16.975ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1567 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = b68852fc-aa7b-4f11-b48d-1b742e0a32f7 response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
34032024-10-19T04:18:17.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0238b10d-4658-44b0-9b2f-9a6127af532b roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34042024-10-19T04:18:17.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0238b10d-4658-44b0-9b2f-9a6127af532b resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34052024-10-19T04:18:17.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0238b10d-4658-44b0-9b2f-9a6127af532b response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34062024-10-19T04:18:18.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ada64f41-99ba-4742-a763-18fd56c48163 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34072024-10-19T04:18:18.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ada64f41-99ba-4742-a763-18fd56c48163 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34082024-10-19T04:18:18.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ada64f41-99ba-4742-a763-18fd56c48163 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34092024-10-19T04:18:19.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ec079f4e-df22-4dd0-ba08-6af9927289f4 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34102024-10-19T04:18:19.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ec079f4e-df22-4dd0-ba08-6af9927289f4 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34112024-10-19T04:18:19.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2862 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ec079f4e-df22-4dd0-ba08-6af9927289f4 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34122024-10-19T04:18:20.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5fcccc8f-ce4b-42f4-9b78-cf7e0915b8f3 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34132024-10-19T04:18:20.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5fcccc8f-ce4b-42f4-9b78-cf7e0915b8f3 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34142024-10-19T04:18:20.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5fcccc8f-ce4b-42f4-9b78-cf7e0915b8f3 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34152024-10-19T04:18:21.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3cc3f3a3-3133-47a5-ab82-b5a914ed68ce roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34162024-10-19T04:18:21.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3cc3f3a3-3133-47a5-ab82-b5a914ed68ce resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34172024-10-19T04:18:21.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3cc3f3a3-3133-47a5-ab82-b5a914ed68ce response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34182024-10-19T04:18:22.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1ed46a40-80a0-45cb-8134-5aa52b2b24ad roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34192024-10-19T04:18:22.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1ed46a40-80a0-45cb-8134-5aa52b2b24ad resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34202024-10-19T04:18:22.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1ed46a40-80a0-45cb-8134-5aa52b2b24ad response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34212024-10-19T04:18:23.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 94923882-65ed-4f52-ad62-5e744bd35961 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34222024-10-19T04:18:23.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 94923882-65ed-4f52-ad62-5e744bd35961 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34232024-10-19T04:18:23.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2874 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 94923882-65ed-4f52-ad62-5e744bd35961 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34242024-10-19T04:18:24.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
34252024-10-19T04:18:24.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34262024-10-19T04:18:24.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
34272024-10-19T04:18:24.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34282024-10-19T04:18:24.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34292024-10-19T04:18:24.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34302024-10-19T04:18:24.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34312024-10-19T04:18:24.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34322024-10-19T04:18:24.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34332024-10-19T04:18:24.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.887027ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34342024-10-19T04:18:24.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34352024-10-19T04:18:24.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34362024-10-19T04:18:24.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34372024-10-19T04:18:24.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34382024-10-19T04:18:24.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34392024-10-19T04:18:24.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34402024-10-19T04:18:24.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
34412024-10-19T04:18:24.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34422024-10-19T04:18:24.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34432024-10-19T04:18:24.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
34442024-10-19T04:18:24.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.125007ms iteration = 56 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
34452024-10-19T04:18:24.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d3c3683a-4332-4554-9c54-925c2f38e027 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34462024-10-19T04:18:24.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d3c3683a-4332-4554-9c54-925c2f38e027 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34472024-10-19T04:18:24.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1791 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d3c3683a-4332-4554-9c54-925c2f38e027 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34482024-10-19T04:18:25.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 45617f13-616f-4514-aa8e-cbae9bc8840a roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34492024-10-19T04:18:25.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 45617f13-616f-4514-aa8e-cbae9bc8840a resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34502024-10-19T04:18:25.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2084 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 45617f13-616f-4514-aa8e-cbae9bc8840a response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34512024-10-19T04:18:26.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 9d1d41ba-5ec8-4a6f-8238-aa1d0f46ef7d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
34522024-10-19T04:18:26.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 9d1d41ba-5ec8-4a6f-8238-aa1d0f46ef7d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
34532024-10-19T04:18:26.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 9d1d41ba-5ec8-4a6f-8238-aa1d0f46ef7d response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
34542024-10-19T04:18:26.975ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1662 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = 03f435aa-4694-4f59-a94d-f4a609625c47 response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
34552024-10-19T04:18:26.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3a54d1b0-961b-4f34-b0b5-3026e4545083 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34562024-10-19T04:18:26.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3a54d1b0-961b-4f34-b0b5-3026e4545083 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34572024-10-19T04:18:26.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2280 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3a54d1b0-961b-4f34-b0b5-3026e4545083 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34582024-10-19T04:18:28.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9b0a4bf7-fe30-4469-9663-b28b0e63f7a1 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34592024-10-19T04:18:28.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9b0a4bf7-fe30-4469-9663-b28b0e63f7a1 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34602024-10-19T04:18:28.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9b0a4bf7-fe30-4469-9663-b28b0e63f7a1 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34612024-10-19T04:18:29.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = cbe67bd0-69ce-4147-8ada-d5a4674fadc8 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34622024-10-19T04:18:29.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = cbe67bd0-69ce-4147-8ada-d5a4674fadc8 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34632024-10-19T04:18:29.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2661 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = cbe67bd0-69ce-4147-8ada-d5a4674fadc8 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34642024-10-19T04:18:30.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f315d430-2692-49e8-87f1-ea0b26db98cb roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34652024-10-19T04:18:30.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f315d430-2692-49e8-87f1-ea0b26db98cb resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34662024-10-19T04:18:30.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f315d430-2692-49e8-87f1-ea0b26db98cb response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34672024-10-19T04:18:31.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 32aa457a-152a-401b-8a56-45a711f26ba1 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34682024-10-19T04:18:31.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 32aa457a-152a-401b-8a56-45a711f26ba1 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34692024-10-19T04:18:31.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 32aa457a-152a-401b-8a56-45a711f26ba1 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34702024-10-19T04:18:32.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 50461580-bcdb-46ed-80ae-1e8dbc86f7e6 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34712024-10-19T04:18:32.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 50461580-bcdb-46ed-80ae-1e8dbc86f7e6 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34722024-10-19T04:18:32.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2623 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 50461580-bcdb-46ed-80ae-1e8dbc86f7e6 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34732024-10-19T04:18:33.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9832bc28-ba17-4a1a-b180-c5e1dc4d681e roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34742024-10-19T04:18:33.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9832bc28-ba17-4a1a-b180-c5e1dc4d681e resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34752024-10-19T04:18:33.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2526 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9832bc28-ba17-4a1a-b180-c5e1dc4d681e response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34762024-10-19T04:18:34.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = b602d9d5-2668-43b9-9013-b95979adbc42 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34772024-10-19T04:18:34.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = b602d9d5-2668-43b9-9013-b95979adbc42 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34782024-10-19T04:18:34.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = b602d9d5-2668-43b9-9013-b95979adbc42 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
34792024-10-19T04:18:34.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
34802024-10-19T04:18:34.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34812024-10-19T04:18:34.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
34822024-10-19T04:18:34.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34832024-10-19T04:18:34.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34842024-10-19T04:18:34.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34852024-10-19T04:18:34.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34862024-10-19T04:18:34.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34872024-10-19T04:18:34.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34882024-10-19T04:18:34.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.515669ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34892024-10-19T04:18:34.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34902024-10-19T04:18:34.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34912024-10-19T04:18:34.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34922024-10-19T04:18:34.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34932024-10-19T04:18:34.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34942024-10-19T04:18:34.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34952024-10-19T04:18:34.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
34962024-10-19T04:18:34.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34972024-10-19T04:18:34.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34982024-10-19T04:18:34.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
34992024-10-19T04:18:34.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.828032ms iteration = 57 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
35002024-10-19T04:18:35.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1f58eb6a-8bc6-429e-8da0-4581b10291d3 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35012024-10-19T04:18:35.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1f58eb6a-8bc6-429e-8da0-4581b10291d3 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35022024-10-19T04:18:35.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1f58eb6a-8bc6-429e-8da0-4581b10291d3 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35032024-10-19T04:18:36.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 083b0b2a-5c70-4565-8391-394d77032627 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35042024-10-19T04:18:36.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 083b0b2a-5c70-4565-8391-394d77032627 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35052024-10-19T04:18:36.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 083b0b2a-5c70-4565-8391-394d77032627 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35062024-10-19T04:18:36.975ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1998 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = 5cdc1268-b402-44bc-8d73-7b115d29ebd4 response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
35072024-10-19T04:18:37.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 99401ebf-0fbe-4328-89d9-25cfa2b8deb6 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35082024-10-19T04:18:37.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 99401ebf-0fbe-4328-89d9-25cfa2b8deb6 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35092024-10-19T04:18:37.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 99401ebf-0fbe-4328-89d9-25cfa2b8deb6 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35102024-10-19T04:18:38.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = c81bfc62-0f9e-427e-8992-b756a1eb9d9a roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35112024-10-19T04:18:38.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = c81bfc62-0f9e-427e-8992-b756a1eb9d9a resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35122024-10-19T04:18:38.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = c81bfc62-0f9e-427e-8992-b756a1eb9d9a response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35132024-10-19T04:18:39.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ef0ee5f0-2955-42b8-a9ec-945eca1a36fe roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35142024-10-19T04:18:39.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ef0ee5f0-2955-42b8-a9ec-945eca1a36fe resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35152024-10-19T04:18:39.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ef0ee5f0-2955-42b8-a9ec-945eca1a36fe response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35162024-10-19T04:18:40.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2593e731-f10f-4cee-907b-644299251f12 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35172024-10-19T04:18:40.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2593e731-f10f-4cee-907b-644299251f12 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35182024-10-19T04:18:40.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2623 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2593e731-f10f-4cee-907b-644299251f12 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35192024-10-19T04:18:41.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e9baa06f-c21a-419f-977d-9f9a0a96d26c roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35202024-10-19T04:18:41.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e9baa06f-c21a-419f-977d-9f9a0a96d26c resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35212024-10-19T04:18:41.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e9baa06f-c21a-419f-977d-9f9a0a96d26c response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35222024-10-19T04:18:42.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 783333f5-4d5c-4466-82ae-7213af651581 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35232024-10-19T04:18:42.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 783333f5-4d5c-4466-82ae-7213af651581 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35242024-10-19T04:18:42.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 783333f5-4d5c-4466-82ae-7213af651581 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35252024-10-19T04:18:43.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = cf959591-98bf-4b3c-bed8-26ebd9b1509e roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35262024-10-19T04:18:43.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = cf959591-98bf-4b3c-bed8-26ebd9b1509e resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35272024-10-19T04:18:43.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = cf959591-98bf-4b3c-bed8-26ebd9b1509e response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35282024-10-19T04:18:44.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1e241ed9-1391-4d22-96d4-05267a61f786 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35292024-10-19T04:18:44.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1e241ed9-1391-4d22-96d4-05267a61f786 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35302024-10-19T04:18:44.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2356 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1e241ed9-1391-4d22-96d4-05267a61f786 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
35312024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
35322024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35332024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
35342024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35352024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
35362024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35372024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
35382024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35392024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
35402024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
35412024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35422024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
35432024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35442024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35452024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35462024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
35472024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35482024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
35492024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35502024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
35512024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
35522024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35532024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35542024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
35552024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35562024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
35572024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
35582024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35592024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
35602024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35612024-10-19T04:18:44.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35622024-10-19T04:18:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35632024-10-19T04:18:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35642024-10-19T04:18:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35652024-10-19T04:18:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35662024-10-19T04:18:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35672024-10-19T04:18:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35682024-10-19T04:18:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
35692024-10-19T04:18:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35702024-10-19T04:18:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35712024-10-19T04:18:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35722024-10-19T04:18:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35732024-10-19T04:18:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35742024-10-19T04:18:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35752024-10-19T04:18:44.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 1.965678ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
35762024-10-19T04:18:44.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35772024-10-19T04:18:44.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35782024-10-19T04:18:44.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35792024-10-19T04:18:44.862ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8890, tv_nsec: 971639552 } })
35802024-10-19T04:18:44.863ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
35812024-10-19T04:18:44.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35822024-10-19T04:18:44.864ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35832024-10-19T04:18:44.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35842024-10-19T04:18:44.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35852024-10-19T04:18:44.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35862024-10-19T04:18:44.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35872024-10-19T04:18:44.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35882024-10-19T04:18:44.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35892024-10-19T04:18:44.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35902024-10-19T04:18:44.865ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.333875ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
35912024-10-19T04:18:44.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35922024-10-19T04:18:44.867ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35932024-10-19T04:18:44.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35942024-10-19T04:18:44.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
35952024-10-19T04:18:44.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35962024-10-19T04:18:44.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35972024-10-19T04:18:44.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35982024-10-19T04:18:44.869ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35992024-10-19T04:18:44.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36002024-10-19T04:18:44.870ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36012024-10-19T04:18:44.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36022024-10-19T04:18:44.870ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
36032024-10-19T04:18:44.870ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36042024-10-19T04:18:44.870ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36052024-10-19T04:18:44.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36062024-10-19T04:18:44.871ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 11.6856ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36072024-10-19T04:18:44.871ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36082024-10-19T04:18:44.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36092024-10-19T04:18:44.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36102024-10-19T04:18:44.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36112024-10-19T04:18:44.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36122024-10-19T04:18:44.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
36132024-10-19T04:18:44.872ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36142024-10-19T04:18:44.872ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36152024-10-19T04:18:44.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36162024-10-19T04:18:44.873ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8890, tv_nsec: 982928504 } })
36172024-10-19T04:18:44.874ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8890, tv_nsec: 983191719 } })
36182024-10-19T04:18:44.874ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36192024-10-19T04:18:44.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36202024-10-19T04:18:44.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36212024-10-19T04:18:44.874ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
36222024-10-19T04:18:44.875ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
36232024-10-19T04:18:44.876ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36242024-10-19T04:18:44.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 16.714289ms iteration = 20 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
36252024-10-19T04:18:44.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
36262024-10-19T04:18:44.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36272024-10-19T04:18:44.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 17.240579ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
36282024-10-19T04:18:44.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36292024-10-19T04:18:44.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36302024-10-19T04:18:44.876ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36312024-10-19T04:18:44.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36322024-10-19T04:18:44.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36332024-10-19T04:18:44.878ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36342024-10-19T04:18:44.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36352024-10-19T04:18:44.878ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36362024-10-19T04:18:44.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36372024-10-19T04:18:44.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36382024-10-19T04:18:44.879ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36392024-10-19T04:18:44.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36402024-10-19T04:18:44.881ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36412024-10-19T04:18:44.881ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 21.470763ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36422024-10-19T04:18:44.883ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
36432024-10-19T04:18:44.883ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.654876ms iteration = 58 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
36442024-10-19T04:18:44.884ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 24.697796ms iteration = 23 status = {"physical_disks_added":0}
36452024-10-19T04:18:44.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36462024-10-19T04:18:44.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36472024-10-19T04:18:44.890ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36482024-10-19T04:18:44.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36492024-10-19T04:18:44.891ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36502024-10-19T04:18:44.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36512024-10-19T04:18:44.891ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36522024-10-19T04:18:44.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36532024-10-19T04:18:44.894ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36542024-10-19T04:18:44.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36552024-10-19T04:18:44.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36562024-10-19T04:18:44.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36572024-10-19T04:18:44.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8180ea00-0a5e-4377-b19a-82e7e60b09bd, lookup_type: ById(8180ea00-0a5e-4377-b19a-82e7e60b09bd) } result = Ok(())
36582024-10-19T04:18:44.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36592024-10-19T04:18:44.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36602024-10-19T04:18:44.897ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36612024-10-19T04:18:44.897ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36622024-10-19T04:18:44.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36632024-10-19T04:18:44.897ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 37.922107ms iteration = 20 status = 0
36642024-10-19T04:18:44.903ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
36652024-10-19T04:18:44.903ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36662024-10-19T04:18:44.903ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 43.730202ms iteration = 20 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
36672024-10-19T04:18:44.967ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
36682024-10-19T04:18:44.967ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36692024-10-19T04:18:44.967ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ea9a3a2e-8997-432f-9a3c-9a3f220ed098", "content-length": "26", "date": "Sat, 19 Oct 2024 04:18:44 GMT"} })
36702024-10-19T04:18:44.967ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36712024-10-19T04:18:44.969ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36722024-10-19T04:18:45.011ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
36732024-10-19T04:18:45.011ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36742024-10-19T04:18:45.011ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b1c932c9-76b6-46b0-b74a-46fc6f5edcba", "content-length": "26", "date": "Sat, 19 Oct 2024 04:18:44 GMT"} })
36752024-10-19T04:18:45.011ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36762024-10-19T04:18:45.013ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36772024-10-19T04:18:45.043ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
36782024-10-19T04:18:45.044ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "90d6254c-30d7-4164-85f7-d4b3c6b3e4ee", "content-length": "691", "date": "Sat, 19 Oct 2024 04:18:45 GMT"} })
36792024-10-19T04:18:45.044ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
36802024-10-19T04:18:45.044ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
36812024-10-19T04:18:45.044ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
36822024-10-19T04:18:45.046ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 187.233559ms iteration = 21 status = {}
36832024-10-19T04:18:45.106ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 246.450065ms iteration = 20 status = {}
36842024-10-19T04:18:45.117ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 zone_address = fd00:1122:3344:101::2
36852024-10-19T04:18:45.117ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36862024-10-19T04:18:45.117ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "894cb803-f0d8-4162-a1ff-7a28d5ea6ac4", "content-length": "26", "date": "Sat, 19 Oct 2024 04:18:44 GMT"} })
36872024-10-19T04:18:45.117ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36882024-10-19T04:18:45.120ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
36892024-10-19T04:18:45.121ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36902024-10-19T04:18:45.122ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7170cfd7-e98c-4a7d-9555-1f18b0cafef0", "content-length": "372", "date": "Sat, 19 Oct 2024 04:18:45 GMT"} })
36912024-10-19T04:18:45.122ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36922024-10-19T04:18:45.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36932024-10-19T04:18:45.122ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36942024-10-19T04:18:45.123ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9eff0717-d396-47db-a9be-c81be34d845e", "content-length": "2", "date": "Sat, 19 Oct 2024 04:18:45 GMT"} })
36952024-10-19T04:18:45.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36962024-10-19T04:18:45.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36972024-10-19T04:18:45.125ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36982024-10-19T04:18:45.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36992024-10-19T04:18:45.126ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37002024-10-19T04:18:45.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37012024-10-19T04:18:45.126ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 267.058931ms iteration = 20 status = null
37022024-10-19T04:18:45.128ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37032024-10-19T04:18:45.128ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e99932b5-1be2-4e55-8f92-e6aa3c6637a8", "date": "Sat, 19 Oct 2024 04:18:45 GMT"} })
37042024-10-19T04:18:45.129ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 270.390456ms iteration = 22 status = {}
37052024-10-19T04:18:45.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37062024-10-19T04:18:45.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37072024-10-19T04:18:45.220ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 67c66fb2-5b53-4f7b-be0b-63b92427bb54, rack_id: 7a4ab4db-4586-4060-be07-8fb242636fc1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ce7dad06-a40f-46ae-96ea-31487ccc19ce) } rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0
37082024-10-19T04:18:45.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37092024-10-19T04:18:45.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37102024-10-19T04:18:45.227ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37112024-10-19T04:18:45.228ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ce6e0b73-9b4b-4c0e-a0d2-dc32d3e22299", "content-length": "121", "date": "Sat, 19 Oct 2024 04:18:45 GMT"} })
37122024-10-19T04:18:45.228ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
37132024-10-19T04:18:45.228ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ce7dad06-a40f-46ae-96ea-31487ccc19ce
37142024-10-19T04:18:45.228ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37152024-10-19T04:18:45.228ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37162024-10-19T04:18:45.228ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {}
37172024-10-19T04:18:45.228ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {}
37182024-10-19T04:18:45.228ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
37192024-10-19T04:18:45.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37202024-10-19T04:18:45.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37212024-10-19T04:18:45.230ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37222024-10-19T04:18:45.230ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c1c94849-eeb2-4d7c-98dc-e47474ff3c03", "content-length": "2", "date": "Sat, 19 Oct 2024 04:18:45 GMT"} })
37232024-10-19T04:18:45.230ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
37242024-10-19T04:18:45.230ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "91a21c40-9acc-4d70-833a-34427ff000df", "content-length": "52", "date": "Sat, 19 Oct 2024 04:18:45 GMT"} })
37252024-10-19T04:18:45.230ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0
37262024-10-19T04:18:45.230ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37272024-10-19T04:18:45.325ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bf50b136-33a0-49bb-9da8-c87bcf98e9b9", "date": "Sat, 19 Oct 2024 04:18:45 GMT"} })
37282024-10-19T04:18:45.325ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch = Switch0
37292024-10-19T04:18:45.325ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37302024-10-19T04:18:45.326ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3f6187bc-4d5b-4862-9b46-4f9cefeaa0ac", "content-length": "667", "date": "Sat, 19 Oct 2024 04:18:45 GMT"} })
37312024-10-19T04:18:45.326ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37322024-10-19T04:18:45.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37332024-10-19T04:18:45.329ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37342024-10-19T04:18:45.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37352024-10-19T04:18:45.331ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37362024-10-19T04:18:45.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37372024-10-19T04:18:45.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37382024-10-19T04:18:45.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37392024-10-19T04:18:45.339ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 479.792011ms iteration = 20 status = {}
37402024-10-19T04:18:45.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9c9eb021-b72c-4067-bb84-49935b8fc920 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37412024-10-19T04:18:45.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9c9eb021-b72c-4067-bb84-49935b8fc920 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37422024-10-19T04:18:45.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9c9eb021-b72c-4067-bb84-49935b8fc920 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37432024-10-19T04:18:46.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 60fba61e-2f45-4208-86fc-f0e74a0be6d2 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37442024-10-19T04:18:46.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 60fba61e-2f45-4208-86fc-f0e74a0be6d2 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37452024-10-19T04:18:46.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2387 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 60fba61e-2f45-4208-86fc-f0e74a0be6d2 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37462024-10-19T04:18:46.975ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1569 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = 232d6c84-6587-4d41-bbab-c51c1053e30f response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
37472024-10-19T04:18:47.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = fd985d94-df7a-4e13-b9f3-357817bb815c roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37482024-10-19T04:18:47.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = fd985d94-df7a-4e13-b9f3-357817bb815c resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37492024-10-19T04:18:47.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = fd985d94-df7a-4e13-b9f3-357817bb815c response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37502024-10-19T04:18:48.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1a3b1287-edae-4766-bbc2-f4bd6f83fcc7 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37512024-10-19T04:18:48.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1a3b1287-edae-4766-bbc2-f4bd6f83fcc7 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37522024-10-19T04:18:48.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2667 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1a3b1287-edae-4766-bbc2-f4bd6f83fcc7 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37532024-10-19T04:18:49.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a3bb7802-584a-4677-8704-689d81298f13 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37542024-10-19T04:18:49.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a3bb7802-584a-4677-8704-689d81298f13 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37552024-10-19T04:18:49.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a3bb7802-584a-4677-8704-689d81298f13 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37562024-10-19T04:18:50.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = bc5b1e25-26ee-4a67-97e2-f67be9c81bc5 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37572024-10-19T04:18:50.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = bc5b1e25-26ee-4a67-97e2-f67be9c81bc5 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37582024-10-19T04:18:50.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = bc5b1e25-26ee-4a67-97e2-f67be9c81bc5 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37592024-10-19T04:18:51.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a9a26c5e-d91b-4dbe-ae3a-329b5ee2b01b roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37602024-10-19T04:18:51.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a9a26c5e-d91b-4dbe-ae3a-329b5ee2b01b resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37612024-10-19T04:18:51.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a9a26c5e-d91b-4dbe-ae3a-329b5ee2b01b response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37622024-10-19T04:18:52.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 8944cf69-321b-49fd-a3e5-0ff966e45f6d roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37632024-10-19T04:18:52.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 8944cf69-321b-49fd-a3e5-0ff966e45f6d resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37642024-10-19T04:18:52.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2787 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 8944cf69-321b-49fd-a3e5-0ff966e45f6d response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37652024-10-19T04:18:53.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0348ac5f-aa38-478e-b3dc-a0f0e05633ec roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37662024-10-19T04:18:53.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0348ac5f-aa38-478e-b3dc-a0f0e05633ec resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37672024-10-19T04:18:53.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2544 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0348ac5f-aa38-478e-b3dc-a0f0e05633ec response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37682024-10-19T04:18:54.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2c6d8f25-357e-4856-81e6-b7a5ed7a93e4 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37692024-10-19T04:18:54.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2c6d8f25-357e-4856-81e6-b7a5ed7a93e4 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37702024-10-19T04:18:54.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2416 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2c6d8f25-357e-4856-81e6-b7a5ed7a93e4 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37712024-10-19T04:18:54.860ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
37722024-10-19T04:18:54.860ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
37732024-10-19T04:18:54.860ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37742024-10-19T04:18:54.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37752024-10-19T04:18:54.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37762024-10-19T04:18:54.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37772024-10-19T04:18:54.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37782024-10-19T04:18:54.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37792024-10-19T04:18:54.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37802024-10-19T04:18:54.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.605601ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37812024-10-19T04:18:54.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37822024-10-19T04:18:54.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37832024-10-19T04:18:54.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37842024-10-19T04:18:54.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37852024-10-19T04:18:54.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37862024-10-19T04:18:54.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37872024-10-19T04:18:54.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
37882024-10-19T04:18:54.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37892024-10-19T04:18:54.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37902024-10-19T04:18:54.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
37912024-10-19T04:18:54.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.677909ms iteration = 59 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
37922024-10-19T04:18:55.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a13a1317-7e50-4a13-b6a7-f5cf577face8 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37932024-10-19T04:18:55.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a13a1317-7e50-4a13-b6a7-f5cf577face8 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37942024-10-19T04:18:55.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2612 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a13a1317-7e50-4a13-b6a7-f5cf577face8 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37952024-10-19T04:18:56.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9487407c-4c36-4e17-8bcd-8bd215c35d77 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37962024-10-19T04:18:56.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9487407c-4c36-4e17-8bcd-8bd215c35d77 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37972024-10-19T04:18:56.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9487407c-4c36-4e17-8bcd-8bd215c35d77 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
37982024-10-19T04:18:56.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = ad039e27-5e1c-4fa0-826b-9f5f13ad8f0c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
37992024-10-19T04:18:56.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = ad039e27-5e1c-4fa0-826b-9f5f13ad8f0c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
38002024-10-19T04:18:56.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2852 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = ad039e27-5e1c-4fa0-826b-9f5f13ad8f0c response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
38012024-10-19T04:18:56.975ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1635 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = 312a66b5-0f6e-4065-be87-1d5d1f0d7fb6 response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
38022024-10-19T04:18:57.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9c610b4f-e863-45ab-9de4-5a8ac3238fd8 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38032024-10-19T04:18:57.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9c610b4f-e863-45ab-9de4-5a8ac3238fd8 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38042024-10-19T04:18:57.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2485 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9c610b4f-e863-45ab-9de4-5a8ac3238fd8 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38052024-10-19T04:18:58.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 152ef7bb-aec3-4490-9b99-ce88d865b460 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38062024-10-19T04:18:58.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 152ef7bb-aec3-4490-9b99-ce88d865b460 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38072024-10-19T04:18:58.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 152ef7bb-aec3-4490-9b99-ce88d865b460 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38082024-10-19T04:18:59.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5d5f3207-8589-4e58-868d-16b725266399 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38092024-10-19T04:18:59.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5d5f3207-8589-4e58-868d-16b725266399 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38102024-10-19T04:18:59.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5d5f3207-8589-4e58-868d-16b725266399 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38112024-10-19T04:19:00.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0ec8d972-4cf9-4a1a-a051-0581aee4c49e roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38122024-10-19T04:19:00.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0ec8d972-4cf9-4a1a-a051-0581aee4c49e resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38132024-10-19T04:19:00.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 0ec8d972-4cf9-4a1a-a051-0581aee4c49e response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38142024-10-19T04:19:01.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 803a539d-8e6a-4c69-9d87-295b72909abc roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38152024-10-19T04:19:01.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 803a539d-8e6a-4c69-9d87-295b72909abc resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38162024-10-19T04:19:01.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2356 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 803a539d-8e6a-4c69-9d87-295b72909abc response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38172024-10-19T04:19:02.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ad18427c-2d09-4ca9-8ba2-0ea9e514a498 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38182024-10-19T04:19:02.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ad18427c-2d09-4ca9-8ba2-0ea9e514a498 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38192024-10-19T04:19:02.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2615 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ad18427c-2d09-4ca9-8ba2-0ea9e514a498 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38202024-10-19T04:19:03.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d0d40d1d-82ae-4594-960b-9aa8ef672085 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38212024-10-19T04:19:03.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d0d40d1d-82ae-4594-960b-9aa8ef672085 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38222024-10-19T04:19:03.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d0d40d1d-82ae-4594-960b-9aa8ef672085 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38232024-10-19T04:19:04.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4e302580-cd35-41c7-be65-896e11ee0a4b roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38242024-10-19T04:19:04.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4e302580-cd35-41c7-be65-896e11ee0a4b resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38252024-10-19T04:19:04.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 4e302580-cd35-41c7-be65-896e11ee0a4b response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38262024-10-19T04:19:04.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
38272024-10-19T04:19:04.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38282024-10-19T04:19:04.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
38292024-10-19T04:19:04.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38302024-10-19T04:19:04.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38312024-10-19T04:19:04.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38322024-10-19T04:19:04.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38332024-10-19T04:19:04.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38342024-10-19T04:19:04.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38352024-10-19T04:19:04.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.871656ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38362024-10-19T04:19:04.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38372024-10-19T04:19:04.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38382024-10-19T04:19:04.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38392024-10-19T04:19:04.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38402024-10-19T04:19:04.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38412024-10-19T04:19:04.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38422024-10-19T04:19:04.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
38432024-10-19T04:19:04.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38442024-10-19T04:19:04.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38452024-10-19T04:19:04.876ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
38462024-10-19T04:19:04.876ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.574467ms iteration = 60 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
38472024-10-19T04:19:05.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2e4e63ed-265a-4dc9-8990-f42bd1a55547 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38482024-10-19T04:19:05.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2e4e63ed-265a-4dc9-8990-f42bd1a55547 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38492024-10-19T04:19:05.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2e4e63ed-265a-4dc9-8990-f42bd1a55547 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38502024-10-19T04:19:06.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 44d22727-b7ed-48f8-badf-672e7f97c34d roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38512024-10-19T04:19:06.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 44d22727-b7ed-48f8-badf-672e7f97c34d resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38522024-10-19T04:19:06.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 44d22727-b7ed-48f8-badf-672e7f97c34d response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38532024-10-19T04:19:06.975ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1871 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = 0db8e2c8-7ead-4dbd-8725-8890dfa72120 response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
38542024-10-19T04:19:07.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f2d70dfe-24f5-42b4-adcc-c9c43330dc60 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38552024-10-19T04:19:07.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f2d70dfe-24f5-42b4-adcc-c9c43330dc60 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38562024-10-19T04:19:07.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2455 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f2d70dfe-24f5-42b4-adcc-c9c43330dc60 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38572024-10-19T04:19:08.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 718928f9-bd86-4257-9a71-504c0f54fad4 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38582024-10-19T04:19:08.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 718928f9-bd86-4257-9a71-504c0f54fad4 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38592024-10-19T04:19:08.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 718928f9-bd86-4257-9a71-504c0f54fad4 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38602024-10-19T04:19:09.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5c37f243-1dec-43cf-84e3-c6cea173187b roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38612024-10-19T04:19:09.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5c37f243-1dec-43cf-84e3-c6cea173187b resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38622024-10-19T04:19:09.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5c37f243-1dec-43cf-84e3-c6cea173187b response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38632024-10-19T04:19:10.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = c0f77296-cfd3-4f16-a1b6-83bc5e182571 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38642024-10-19T04:19:10.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = c0f77296-cfd3-4f16-a1b6-83bc5e182571 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38652024-10-19T04:19:10.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = c0f77296-cfd3-4f16-a1b6-83bc5e182571 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38662024-10-19T04:19:11.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a1189b71-37c9-4dfb-b2f8-f667f9a42291 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38672024-10-19T04:19:11.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a1189b71-37c9-4dfb-b2f8-f667f9a42291 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38682024-10-19T04:19:11.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = a1189b71-37c9-4dfb-b2f8-f667f9a42291 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38692024-10-19T04:19:12.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5d4d67ad-1790-48e7-ba8c-b4dacb0ae17d roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38702024-10-19T04:19:12.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5d4d67ad-1790-48e7-ba8c-b4dacb0ae17d resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38712024-10-19T04:19:12.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1946 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 5d4d67ad-1790-48e7-ba8c-b4dacb0ae17d response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38722024-10-19T04:19:13.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2aaedb61-5457-41aa-8025-07138fe1cca9 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38732024-10-19T04:19:13.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2aaedb61-5457-41aa-8025-07138fe1cca9 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38742024-10-19T04:19:13.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2aaedb61-5457-41aa-8025-07138fe1cca9 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
38752024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
38762024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
38772024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38782024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
38792024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
38802024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38812024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
38822024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
38832024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
38842024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38852024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
38862024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
38872024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38882024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
38892024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38902024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
38912024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
38922024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38932024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
38942024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
38952024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38962024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38972024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38982024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
38992024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39002024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
39012024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
39022024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
39032024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39042024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
39052024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
39062024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
39072024-10-19T04:19:14.859ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
39082024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39092024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39102024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
39112024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
39122024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
39132024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39142024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39152024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
39162024-10-19T04:19:14.859ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
39172024-10-19T04:19:14.859ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
39182024-10-19T04:19:14.860ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
39192024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
39202024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
39212024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
39222024-10-19T04:19:14.860ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
39232024-10-19T04:19:14.860ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931
39242024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
39252024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.571\u{b5}s iteration = 12 status = {"error":"blueprint disabled","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931"}
39262024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
39272024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
39282024-10-19T04:19:14.860ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-19 04:09:14.860036369 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
39292024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39302024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
39312024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
39322024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39332024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
39342024-10-19T04:19:14.860ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
39352024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
39362024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39372024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
39382024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39392024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39402024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39412024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39422024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39432024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39442024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39452024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39462024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39472024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
39482024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39492024-10-19T04:19:14.860ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("077283a3-2f69-419e-8ab2-1088c51300c6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0f0b5b4d-c580-4418-9bbc-5d1b6d257b94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a79265b8-3f31-40c4-bdbb-3f2463bd3c30.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a79265b8-3f31-40c4-bdbb-3f2463bd3c30.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 8920, tv_nsec: 969378287 } })
39502024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39512024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39522024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39532024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39542024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39552024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
39562024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39572024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39582024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
39592024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39602024-10-19T04:19:14.860ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
39612024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39622024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39632024-10-19T04:19:14.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
39642024-10-19T04:19:14.861ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3881ebd6-060e-4a3f-8035-5fd76566e5d0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4ba9b73a-0f82-489d-a9fb-902be604440b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("4ba9b73a-0f82-489d-a9fb-902be604440b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 8920, tv_nsec: 970628982 } })
39652024-10-19T04:19:14.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.196754ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
39662024-10-19T04:19:14.862ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
39672024-10-19T04:19:14.862ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.124181ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
39682024-10-19T04:19:14.862ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 2.872807ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
39692024-10-19T04:19:14.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39702024-10-19T04:19:14.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39712024-10-19T04:19:14.863ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39722024-10-19T04:19:14.863ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.56826ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39732024-10-19T04:19:14.863ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
39742024-10-19T04:19:14.863ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.932238ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
39752024-10-19T04:19:14.864ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8920, tv_nsec: 972946357 } })
39762024-10-19T04:19:14.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39772024-10-19T04:19:14.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39782024-10-19T04:19:14.864ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39792024-10-19T04:19:14.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39802024-10-19T04:19:14.864ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
39812024-10-19T04:19:14.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39822024-10-19T04:19:14.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39832024-10-19T04:19:14.865ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39842024-10-19T04:19:14.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39852024-10-19T04:19:14.865ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39862024-10-19T04:19:14.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39872024-10-19T04:19:14.866ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39882024-10-19T04:19:14.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39892024-10-19T04:19:14.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39902024-10-19T04:19:14.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39912024-10-19T04:19:14.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
39922024-10-19T04:19:14.866ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39932024-10-19T04:19:14.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39942024-10-19T04:19:14.866ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39952024-10-19T04:19:14.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39962024-10-19T04:19:14.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39972024-10-19T04:19:14.867ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8920, tv_nsec: 975910926 } })
39982024-10-19T04:19:14.867ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39992024-10-19T04:19:14.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 7.961267ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40002024-10-19T04:19:14.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40012024-10-19T04:19:14.868ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40022024-10-19T04:19:14.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40032024-10-19T04:19:14.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40042024-10-19T04:19:14.868ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
40052024-10-19T04:19:14.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40062024-10-19T04:19:14.868ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8920, tv_nsec: 977420806 } })
40072024-10-19T04:19:14.868ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-19 04:09:14.860036369 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
40082024-10-19T04:19:14.868ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.555288ms iteration = 11 status = {"expiration":"2024-10-19T04:09:14.860036369Z","pruned":[]}
40092024-10-19T04:19:14.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40102024-10-19T04:19:14.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40112024-10-19T04:19:14.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40122024-10-19T04:19:14.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40132024-10-19T04:19:14.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40142024-10-19T04:19:14.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40152024-10-19T04:19:14.869ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
40162024-10-19T04:19:14.869ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
40172024-10-19T04:19:14.869ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 9.107249ms iteration = 11 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
40182024-10-19T04:19:14.869ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40192024-10-19T04:19:14.869ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
40202024-10-19T04:19:14.869ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
40212024-10-19T04:19:14.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40222024-10-19T04:19:14.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40232024-10-19T04:19:14.869ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40242024-10-19T04:19:14.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
40252024-10-19T04:19:14.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 9.860664ms iteration = 21 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
40262024-10-19T04:19:14.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40272024-10-19T04:19:14.869ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
40282024-10-19T04:19:14.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40292024-10-19T04:19:14.870ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
40302024-10-19T04:19:14.870ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40312024-10-19T04:19:14.870ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40322024-10-19T04:19:14.870ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40332024-10-19T04:19:14.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40342024-10-19T04:19:14.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40352024-10-19T04:19:14.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40362024-10-19T04:19:14.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40372024-10-19T04:19:14.871ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40382024-10-19T04:19:14.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40392024-10-19T04:19:14.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40402024-10-19T04:19:14.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40412024-10-19T04:19:14.871ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40422024-10-19T04:19:14.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
40432024-10-19T04:19:14.872ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40442024-10-19T04:19:14.872ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
40452024-10-19T04:19:14.872ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
40462024-10-19T04:19:14.872ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
40472024-10-19T04:19:14.872ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
40482024-10-19T04:19:14.872ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40492024-10-19T04:19:14.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40502024-10-19T04:19:14.872ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 12.379644ms iteration = 21 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
40512024-10-19T04:19:14.872ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40522024-10-19T04:19:14.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40532024-10-19T04:19:14.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40542024-10-19T04:19:14.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40552024-10-19T04:19:14.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40562024-10-19T04:19:14.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40572024-10-19T04:19:14.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40582024-10-19T04:19:14.872ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(4a9381d8-b2cc-4a34-bc1d-8f0aef8bb3db, 0), (e4fd4aec-790f-4a1a-ae8a-8c2198583f1b, 0), (26ee5e9a-bcce-4c7a-9863-bfc53dd28ce4, 0), (2056cd1e-f366-4a2e-baf5-79c455932b32, 0)] collection_id = 4a9381d8-b2cc-4a34-bc1d-8f0aef8bb3db
40592024-10-19T04:19:14.872ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
40602024-10-19T04:19:14.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
40612024-10-19T04:19:14.873ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40622024-10-19T04:19:14.873ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40632024-10-19T04:19:14.873ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40642024-10-19T04:19:14.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40652024-10-19T04:19:14.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40662024-10-19T04:19:14.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40672024-10-19T04:19:14.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40682024-10-19T04:19:14.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40692024-10-19T04:19:14.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40702024-10-19T04:19:14.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40712024-10-19T04:19:14.874ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
40722024-10-19T04:19:14.874ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
40732024-10-19T04:19:14.874ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 14.855972ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
40742024-10-19T04:19:14.875ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40752024-10-19T04:19:14.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
40762024-10-19T04:19:14.875ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40772024-10-19T04:19:14.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40782024-10-19T04:19:14.876ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40792024-10-19T04:19:14.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40802024-10-19T04:19:14.877ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40812024-10-19T04:19:14.878ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40822024-10-19T04:19:14.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40832024-10-19T04:19:14.879ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 19.326201ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
40842024-10-19T04:19:14.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40852024-10-19T04:19:14.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40862024-10-19T04:19:14.879ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
40872024-10-19T04:19:14.879ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
40882024-10-19T04:19:14.879ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
40892024-10-19T04:19:14.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40902024-10-19T04:19:14.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40912024-10-19T04:19:14.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40922024-10-19T04:19:14.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
40932024-10-19T04:19:14.880ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40942024-10-19T04:19:14.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40952024-10-19T04:19:14.880ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
40962024-10-19T04:19:14.880ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = fb44ee4c-c5ec-4992-abdf-b6f7e2fadda5 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
40972024-10-19T04:19:14.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40982024-10-19T04:19:14.880ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40992024-10-19T04:19:14.880ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.711188ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
41002024-10-19T04:19:14.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41012024-10-19T04:19:14.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41022024-10-19T04:19:14.880ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41032024-10-19T04:19:14.880ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41042024-10-19T04:19:14.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
41052024-10-19T04:19:14.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41062024-10-19T04:19:14.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41072024-10-19T04:19:14.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41082024-10-19T04:19:14.881ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41092024-10-19T04:19:14.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41102024-10-19T04:19:14.881ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41112024-10-19T04:19:14.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41122024-10-19T04:19:14.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41132024-10-19T04:19:14.882ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41142024-10-19T04:19:14.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41152024-10-19T04:19:14.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41162024-10-19T04:19:14.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41172024-10-19T04:19:14.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41182024-10-19T04:19:14.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41192024-10-19T04:19:14.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41202024-10-19T04:19:14.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41212024-10-19T04:19:14.885ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41222024-10-19T04:19:14.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41232024-10-19T04:19:14.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41242024-10-19T04:19:14.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41252024-10-19T04:19:14.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41262024-10-19T04:19:14.885ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
41272024-10-19T04:19:14.885ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a4077ac0-652e-4998-9c99-e66a22abccb6 dns_zone_name = oxide.test found_so_far = 0 version = 2
41282024-10-19T04:19:14.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41292024-10-19T04:19:14.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41302024-10-19T04:19:14.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41312024-10-19T04:19:14.886ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41322024-10-19T04:19:14.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41332024-10-19T04:19:14.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41342024-10-19T04:19:14.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41352024-10-19T04:19:14.887ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = fb44ee4c-c5ec-4992-abdf-b6f7e2fadda5 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
41362024-10-19T04:19:14.887ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
41372024-10-19T04:19:14.887ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-19 04:10:05.441343 UTC dns_group = internal generation = 1
41382024-10-19T04:19:14.887ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 27.833988ms iteration = 12 status = {"generation":1}
41392024-10-19T04:19:14.887ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41402024-10-19T04:19:14.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41412024-10-19T04:19:14.888ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
41422024-10-19T04:19:14.888ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.565133ms iteration = 61 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
41432024-10-19T04:19:14.889ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41442024-10-19T04:19:14.889ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-19T04:09:14.003740Z, time_modified: 2024-10-19T04:09:14.003740Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, db_silo: Silo { identity: SiloIdentity { id: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-19T04:10:05.838166Z, time_modified: 2024-10-19T04:10:05.838166Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1f4033bd55b23e094b1263660016971c2c68cc6162a83dcd709c701bd968e3c5" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, db_silo: Silo { identity: SiloIdentity { id: 54ab3538-1bb1-4d5e-a518-5d0dec26f2d7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-19T04:10:05.838166Z, time_modified: 2024-10-19T04:10:05.838166Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1f4033bd55b23e094b1263660016971c2c68cc6162a83dcd709c701bd968e3c5" }] }) }
41452024-10-19T04:19:14.889ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 30.186524ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"54ab3538-1bb1-4d5e-a518-5d0dec26f2d7","tls_certs":["1f4033bd55b23e094b1263660016971c2c68cc6162a83dcd709c701bd968e3c5"]}},"default_endpoint":{"silo_id":"54ab3538-1bb1-4d5e-a518-5d0dec26f2d7","tls_certs":["1f4033bd55b23e094b1263660016971c2c68cc6162a83dcd709c701bd968e3c5"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
41462024-10-19T04:19:14.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41472024-10-19T04:19:14.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41482024-10-19T04:19:14.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8180ea00-0a5e-4377-b19a-82e7e60b09bd, lookup_type: ById(8180ea00-0a5e-4377-b19a-82e7e60b09bd) } result = Ok(())
41492024-10-19T04:19:14.890ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41502024-10-19T04:19:14.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41512024-10-19T04:19:14.890ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 31.184964ms iteration = 24 status = {"physical_disks_added":0}
41522024-10-19T04:19:14.891ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41532024-10-19T04:19:14.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41542024-10-19T04:19:14.891ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41552024-10-19T04:19:14.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41562024-10-19T04:19:14.891ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 32.244045ms iteration = 21 status = 0
41572024-10-19T04:19:14.892ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a4077ac0-652e-4998-9c99-e66a22abccb6 dns_zone_name = oxide.test found_so_far = 1 version = 2
41582024-10-19T04:19:14.893ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
41592024-10-19T04:19:14.893ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-19 04:10:05.874167 UTC dns_group = external generation = 2
41602024-10-19T04:19:14.893ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 33.143973ms iteration = 12 status = {"generation":2}
41612024-10-19T04:19:14.893ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41622024-10-19T04:19:14.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41632024-10-19T04:19:14.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41642024-10-19T04:19:14.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
41652024-10-19T04:19:14.894ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41662024-10-19T04:19:14.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41672024-10-19T04:19:14.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41682024-10-19T04:19:14.896ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41692024-10-19T04:19:14.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41702024-10-19T04:19:14.897ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41712024-10-19T04:19:14.897ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41722024-10-19T04:19:14.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41732024-10-19T04:19:14.898ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41742024-10-19T04:19:14.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41752024-10-19T04:19:14.899ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41762024-10-19T04:19:14.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41772024-10-19T04:19:14.900ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41782024-10-19T04:19:14.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41792024-10-19T04:19:14.901ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41802024-10-19T04:19:14.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41812024-10-19T04:19:14.903ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41822024-10-19T04:19:14.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41832024-10-19T04:19:14.903ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 4a9381d8-b2cc-4a34-bc1d-8f0aef8bb3db file = nexus/db-queries/src/db/datastore/inventory.rs:1299 ncabooses = 12 ncollections = 1 nerrors = 0 nnics = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
41842024-10-19T04:19:14.903ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
41852024-10-19T04:19:14.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
41862024-10-19T04:19:14.904ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41872024-10-19T04:19:14.906ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(e4fd4aec-790f-4a1a-ae8a-8c2198583f1b, 0), (26ee5e9a-bcce-4c7a-9863-bfc53dd28ce4, 0), (2056cd1e-f366-4a2e-baf5-79c455932b32, 0)]
41882024-10-19T04:19:14.906ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
41892024-10-19T04:19:14.906ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8180ea00-0a5e-4377-b19a-82e7e60b09bd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 8921, tv_nsec: 15559837 } })
41902024-10-19T04:19:14.906ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = dcab0c57-8928-431c-9e1f-97e86d3b495c
41912024-10-19T04:19:14.906ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 8c0edbf5-2657-47e0-b8f8-f92cf0546cec
41922024-10-19T04:19:14.906ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 7173d246-1aed-4e54-baed-50620a65d707
41932024-10-19T04:19:14.906ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37
41942024-10-19T04:19:14.906ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 74810e75-6b28-4294-9442-74d172a0c174
41952024-10-19T04:19:14.906ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 418dd31b-ee10-4f2b-b6dd-e4d1b0d6ba37
41962024-10-19T04:19:14.906ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 7173d246-1aed-4e54-baed-50620a65d707
41972024-10-19T04:19:14.906ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 74810e75-6b28-4294-9442-74d172a0c174
41982024-10-19T04:19:14.906ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 8c0edbf5-2657-47e0-b8f8-f92cf0546cec
41992024-10-19T04:19:14.906ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = dcab0c57-8928-431c-9e1f-97e86d3b495c
42002024-10-19T04:19:14.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
42012024-10-19T04:19:14.907ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42022024-10-19T04:19:14.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42032024-10-19T04:19:14.908ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42042024-10-19T04:19:14.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42052024-10-19T04:19:14.909ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 49.042976ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":5,"recent_failures":[],"recent_recoveries":[]}
42062024-10-19T04:19:14.909ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42072024-10-19T04:19:14.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42082024-10-19T04:19:14.912ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42092024-10-19T04:19:14.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42102024-10-19T04:19:14.913ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42112024-10-19T04:19:14.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42122024-10-19T04:19:14.915ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42132024-10-19T04:19:14.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42142024-10-19T04:19:14.916ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42152024-10-19T04:19:14.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42162024-10-19T04:19:14.917ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42172024-10-19T04:19:14.920ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
42182024-10-19T04:19:14.920ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42192024-10-19T04:19:14.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42202024-10-19T04:19:14.921ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42212024-10-19T04:19:14.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42222024-10-19T04:19:14.923ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42232024-10-19T04:19:14.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42242024-10-19T04:19:14.924ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42252024-10-19T04:19:14.927ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
42262024-10-19T04:19:14.927ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42272024-10-19T04:19:14.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42282024-10-19T04:19:14.931ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42292024-10-19T04:19:14.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42302024-10-19T04:19:14.932ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42312024-10-19T04:19:14.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42322024-10-19T04:19:14.933ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42332024-10-19T04:19:14.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42342024-10-19T04:19:14.935ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42352024-10-19T04:19:14.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42362024-10-19T04:19:14.936ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42372024-10-19T04:19:14.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42382024-10-19T04:19:14.937ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42392024-10-19T04:19:14.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42402024-10-19T04:19:14.938ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42412024-10-19T04:19:14.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42422024-10-19T04:19:14.939ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42432024-10-19T04:19:14.942ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
42442024-10-19T04:19:14.942ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42452024-10-19T04:19:14.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42462024-10-19T04:19:14.944ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42472024-10-19T04:19:14.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42482024-10-19T04:19:14.945ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42492024-10-19T04:19:14.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42502024-10-19T04:19:14.946ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42512024-10-19T04:19:14.949ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
42522024-10-19T04:19:14.949ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42532024-10-19T04:19:14.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42542024-10-19T04:19:14.954ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 33533ad5-2e9d-4d64-8e65-7bc3f900b466, kind: Service { id: 3881ebd6-060e-4a3f-8035-5fd76566e5d0 }, name: Name("external-dns-3881ebd6-060e-4a3f-8035-5fd76566e5d0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 31])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f159ce02-db21-4bd5-939d-6d1323fd3499, kind: Service { id: 4ba9b73a-0f82-489d-a9fb-902be604440b }, name: Name("external-dns-4ba9b73a-0f82-489d-a9fb-902be604440b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 168])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 4f277d20-a38d-4851-94f5-58409e26a8a0, kind: Service { id: a467d800-84cc-458f-bc0b-79f4d850221d }, name: Name("nexus-a467d800-84cc-458f-bc0b-79f4d850221d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 147])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 52584243-3f13-454e-852d-853062936350, kind: Service { id: 613e815e-cc58-43ed-80bc-ffd165040e7b }, name: Name("nexus-613e815e-cc58-43ed-80bc-ffd165040e7b"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 6])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e0c5baf1-d654-49ad-af79-a663eadda096, kind: Service { id: f52456a9-c6e1-4493-862e-5f5e50745c76 }, name: Name("nexus-f52456a9-c6e1-4493-862e-5f5e50745c76"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
42552024-10-19T04:19:14.954ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42562024-10-19T04:19:14.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42572024-10-19T04:19:14.955ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42582024-10-19T04:19:14.957ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
42592024-10-19T04:19:14.957ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42602024-10-19T04:19:14.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42612024-10-19T04:19:14.958ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
42622024-10-19T04:19:14.958ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 33533ad5-2e9d-4d64-8e65-7bc3f900b466, kind: Service { id: 3881ebd6-060e-4a3f-8035-5fd76566e5d0 }, name: Name("external-dns-3881ebd6-060e-4a3f-8035-5fd76566e5d0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 31])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f159ce02-db21-4bd5-939d-6d1323fd3499, kind: Service { id: 4ba9b73a-0f82-489d-a9fb-902be604440b }, name: Name("external-dns-4ba9b73a-0f82-489d-a9fb-902be604440b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 168])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4f277d20-a38d-4851-94f5-58409e26a8a0, kind: Service { id: a467d800-84cc-458f-bc0b-79f4d850221d }, name: Name("nexus-a467d800-84cc-458f-bc0b-79f4d850221d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 147])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 52584243-3f13-454e-852d-853062936350, kind: Service { id: 613e815e-cc58-43ed-80bc-ffd165040e7b }, name: Name("nexus-613e815e-cc58-43ed-80bc-ffd165040e7b"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 6])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e0c5baf1-d654-49ad-af79-a663eadda096, kind: Service { id: f52456a9-c6e1-4493-862e-5f5e50745c76 }, name: Name("nexus-f52456a9-c6e1-4493-862e-5f5e50745c76"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
42632024-10-19T04:19:14.958ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
42642024-10-19T04:19:14.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ddfda5df-cf8a-4b22-bdfb-604f9e32ed93 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
42652024-10-19T04:19:14.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ddfda5df-cf8a-4b22-bdfb-604f9e32ed93 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
42662024-10-19T04:19:14.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ddfda5df-cf8a-4b22-bdfb-604f9e32ed93 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
42672024-10-19T04:19:15.017ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 8180ea00-0a5e-4377-b19a-82e7e60b09bd, time_created: 2024-10-19T04:09:57.952385Z, time_modified: 2024-10-19T04:09:57.952385Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 7a4ab4db-4586-4060-be07-8fb242636fc1, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
42682024-10-19T04:19:15.017ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
42692024-10-19T04:19:15.017ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42702024-10-19T04:19:15.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42712024-10-19T04:19:15.019ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42722024-10-19T04:19:15.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42732024-10-19T04:19:15.020ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42742024-10-19T04:19:15.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 8180ea00-0a5e-4377-b19a-82e7e60b09bd, lookup_type: ById(8180ea00-0a5e-4377-b19a-82e7e60b09bd) } result = Ok(())
42752024-10-19T04:19:15.140ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
42762024-10-19T04:19:15.169ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
42772024-10-19T04:19:15.169ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42782024-10-19T04:19:15.169ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "34fddff7-36aa-4b28-97c9-3e00475e3616", "content-length": "26", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
42792024-10-19T04:19:15.169ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42802024-10-19T04:19:15.171ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42812024-10-19T04:19:15.181ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
42822024-10-19T04:19:15.182ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
42832024-10-19T04:19:15.182ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42842024-10-19T04:19:15.182ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6bd12ee5-89d9-4a0a-8c15-82d91b90955a", "content-length": "26", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
42852024-10-19T04:19:15.182ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42862024-10-19T04:19:15.184ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42872024-10-19T04:19:15.196ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 zone_address = fd00:1122:3344:101::2
42882024-10-19T04:19:15.196ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42892024-10-19T04:19:15.196ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a6db6be0-c187-4815-8ceb-2a59aafe1a0c", "content-length": "26", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
42902024-10-19T04:19:15.196ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42912024-10-19T04:19:15.197ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
42922024-10-19T04:19:15.245ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42932024-10-19T04:19:15.246ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f1545342-9849-41a1-8804-3025422ee406", "content-length": "372", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
42942024-10-19T04:19:15.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42952024-10-19T04:19:15.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42962024-10-19T04:19:15.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42972024-10-19T04:19:15.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42982024-10-19T04:19:15.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42992024-10-19T04:19:15.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43002024-10-19T04:19:15.253ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43012024-10-19T04:19:15.253ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "eb3c8fc9-3927-487d-872b-9eabfb1da386", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43022024-10-19T04:19:15.255ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 395.47486ms iteration = 23 status = {}
43032024-10-19T04:19:15.281ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
43042024-10-19T04:19:15.282ZDEBGnexus (BackgroundTasks): client request SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
43052024-10-19T04:19:15.283ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = service_firewall_rule_propagation result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "54ee3db8-d50a-4996-8378-5751d350a91e", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43062024-10-19T04:19:15.285ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
43072024-10-19T04:19:15.285ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 425.38015ms
43082024-10-19T04:19:15.285ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 425.38769ms iteration = 3 status = {}
43092024-10-19T04:19:15.285ZDEBGnexus (BackgroundTasks): client response SledAgent = 8180ea00-0a5e-4377-b19a-82e7e60b09bd background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2c7eeba2-607a-442b-b76e-03555dd8683b", "content-length": "691", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43102024-10-19T04:19:15.285ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
43112024-10-19T04:19:15.285ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
43122024-10-19T04:19:15.285ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
43132024-10-19T04:19:15.287ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 427.002092ms iteration = 22 status = {}
43142024-10-19T04:19:15.377ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
43152024-10-19T04:19:15.377ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
43162024-10-19T04:19:15.377ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
43172024-10-19T04:19:15.377ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/ignition", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e7ed5731-b5e0-44a5-abaf-bf6df10ae2c3", "content-length": "476", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43182024-10-19T04:19:15.377ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
43192024-10-19T04:19:15.378ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b78e60a1-5d99-4be9-8219-fef70307a64d", "content-length": "734", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43202024-10-19T04:19:15.378ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
43212024-10-19T04:19:15.378ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "809b2cd9-6064-4856-b046-24179834a670", "content-length": "86", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43222024-10-19T04:19:15.378ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
43232024-10-19T04:19:15.378ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8610d6e9-91ea-4fb7-906d-b977eb19350c", "content-length": "86", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43242024-10-19T04:19:15.378ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
43252024-10-19T04:19:15.380ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "83be93dc-4505-4aed-9cf4-75132c99745b", "content-length": "80", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43262024-10-19T04:19:15.380ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
43272024-10-19T04:19:15.380ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4c03c36b-35b4-4cb0-9ea2-4fdd6086b931", "content-length": "80", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43282024-10-19T04:19:15.380ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
43292024-10-19T04:19:15.380ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "707486e3-ce89-46ef-91db-df2547ee0077", "content-length": "88", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43302024-10-19T04:19:15.381ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
43312024-10-19T04:19:15.381ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "43861a9f-7f13-472e-81d9-468a7433c5e1", "content-length": "88", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43322024-10-19T04:19:15.381ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
43332024-10-19T04:19:15.381ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a4311507-f835-4439-8fe0-29c8f2b3d625", "content-length": "702", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43342024-10-19T04:19:15.381ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
43352024-10-19T04:19:15.381ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3d6ba975-e106-44a6-889b-5c29f55c8617", "content-length": "727", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43362024-10-19T04:19:15.381ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
43372024-10-19T04:19:15.383ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cbf50562-78fa-469e-8e1d-dc7b9bdfbc19", "content-length": "729", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43382024-10-19T04:19:15.383ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
43392024-10-19T04:19:15.383ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "981af94d-0e2a-4d04-98cc-40d2cfc79c77", "content-length": "728", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43402024-10-19T04:19:15.383ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
43412024-10-19T04:19:15.383ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bf522fb5-8f22-4ca2-a210-ce3ca705445b", "content-length": "722", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43422024-10-19T04:19:15.383ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
43432024-10-19T04:19:15.383ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "17de701c-a560-4c37-9c0d-80d730072d9c", "content-length": "84", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43442024-10-19T04:19:15.383ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
43452024-10-19T04:19:15.384ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5301676d-c02d-40e4-a7ae-c689292ca0d4", "content-length": "84", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43462024-10-19T04:19:15.384ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
43472024-10-19T04:19:15.384ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
43482024-10-19T04:19:15.384ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "74781526-fb9d-429e-afb4-7213791f0020", "content-length": "82", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43492024-10-19T04:19:15.384ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
43502024-10-19T04:19:15.386ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bd1ea0d9-71eb-4a50-86eb-101aa17bb82e", "content-length": "2", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43512024-10-19T04:19:15.386ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "733797ed-8167-4962-aa81-3762390d7fef", "content-length": "82", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43522024-10-19T04:19:15.386ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
43532024-10-19T04:19:15.386ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2415683e-ac66-4c5d-8cf7-637adb353b23", "content-length": "91", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43542024-10-19T04:19:15.386ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
43552024-10-19T04:19:15.386ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ad1657d8-37d9-432d-b997-e3fd46f1422e", "content-length": "91", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43562024-10-19T04:19:15.386ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
43572024-10-19T04:19:15.386ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d116da2e-d7d0-4f00-b0ba-4ed39af4f1a8", "content-length": "702", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43582024-10-19T04:19:15.386ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
43592024-10-19T04:19:15.387ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2d6697e2-9bd5-4715-970b-704082c1e392", "content-length": "727", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43602024-10-19T04:19:15.387ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
43612024-10-19T04:19:15.387ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a0ef9fd1-4680-4b8c-9517-a7a54d0c2e60", "content-length": "729", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43622024-10-19T04:19:15.387ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
43632024-10-19T04:19:15.387ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8e7c1e72-431e-4033-9c35-2a17165e63a2", "content-length": "728", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
43642024-10-19T04:19:15.387ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
43652024-10-19T04:19:15.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
43662024-10-19T04:19:15.388ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43672024-10-19T04:19:15.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43682024-10-19T04:19:15.389ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43692024-10-19T04:19:15.390ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 530.016301ms iteration = 21 status = null
43702024-10-19T04:19:15.390ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 530.364497ms iteration = 21 status = {}
43712024-10-19T04:19:15.391ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
43722024-10-19T04:19:15.391ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
43732024-10-19T04:19:15.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
43742024-10-19T04:19:15.393ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43752024-10-19T04:19:15.396ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
43762024-10-19T04:19:15.396ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
43772024-10-19T04:19:15.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
43782024-10-19T04:19:15.399ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
43792024-10-19T04:19:15.400ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "202dc08b-d703-48e9-8828-1c34130e842f", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43802024-10-19T04:19:15.400ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43812024-10-19T04:19:15.401ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "52ae4fb3-2959-4501-a96c-df6aa23041e0", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43822024-10-19T04:19:15.401ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43832024-10-19T04:19:15.403ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43842024-10-19T04:19:15.403ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 543.360973ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
43852024-10-19T04:19:15.414ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
43862024-10-19T04:19:15.467ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
43872024-10-19T04:19:15.467ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
43882024-10-19T04:19:15.518ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
43892024-10-19T04:19:15.519ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "86fa09a4-25f2-4d72-92d5-2d91dac3d3f3", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43902024-10-19T04:19:15.519ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43912024-10-19T04:19:15.521ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ad21358c-51df-4922-b4b6-8bd2927ecff5", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43922024-10-19T04:19:15.521ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43932024-10-19T04:19:15.522ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e446eaf3-935a-479f-bff0-24e3d1cb21e0", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43942024-10-19T04:19:15.522ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43952024-10-19T04:19:15.525ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43962024-10-19T04:19:15.525ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 665.312086ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
43972024-10-19T04:19:15.529ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43982024-10-19T04:19:15.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43992024-10-19T04:19:15.531ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 67c66fb2-5b53-4f7b-be0b-63b92427bb54, rack_id: 7a4ab4db-4586-4060-be07-8fb242636fc1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(ce7dad06-a40f-46ae-96ea-31487ccc19ce) } rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0
44002024-10-19T04:19:15.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44012024-10-19T04:19:15.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44022024-10-19T04:19:15.540ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
44032024-10-19T04:19:15.540ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c75d5e1e-bbb4-4f77-acac-2270c054270c", "content-length": "121", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
44042024-10-19T04:19:15.540ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
44052024-10-19T04:19:15.540ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = ce7dad06-a40f-46ae-96ea-31487ccc19ce
44062024-10-19T04:19:15.540ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44072024-10-19T04:19:15.540ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44082024-10-19T04:19:15.540ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {}
44092024-10-19T04:19:15.540ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 routes = {}
44102024-10-19T04:19:15.540ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1
44112024-10-19T04:19:15.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44122024-10-19T04:19:15.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44132024-10-19T04:19:15.542ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44142024-10-19T04:19:15.542ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1d9accfd-162d-4c4d-a419-8a026151d792", "content-length": "2", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
44152024-10-19T04:19:15.542ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44162024-10-19T04:19:15.543ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3353cf42-a561-48fe-8f25-afcb1ef1fd38", "content-length": "52", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
44172024-10-19T04:19:15.543ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch_location = Switch0
44182024-10-19T04:19:15.543ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44192024-10-19T04:19:15.559ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/inventory", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7056bf2d-02d3-4340-82c3-cd2a3928333a", "content-length": "2360", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
44202024-10-19T04:19:15.559ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/omicron-zones
44212024-10-19T04:19:15.565ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/omicron-zones", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "22215423-6ae9-4328-8fcd-c42181681765", "content-length": "10314", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
44222024-10-19T04:19:15.566ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
44232024-10-19T04:19:15.566ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
44242024-10-19T04:19:15.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
44252024-10-19T04:19:15.568ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44262024-10-19T04:19:15.570ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
44272024-10-19T04:19:15.574ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
44282024-10-19T04:19:15.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
44292024-10-19T04:19:15.628ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 09595a1e-c81c-4bd3-89ed-dc0a6c293329 file = nexus/db-queries/src/db/datastore/inventory.rs:893
44302024-10-19T04:19:15.630ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 09595a1e-c81c-4bd3-89ed-dc0a6c293329 time_started = 2024-10-19 04:19:15.376194 UTC
44312024-10-19T04:19:15.630ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 770.659431ms iteration = 4 status = {"collection_id":"09595a1e-c81c-4bd3-89ed-dc0a6c293329","time_done":"2024-10-19 04:19:15.566501 UTC","time_started":"2024-10-19 04:19:15.376194 UTC"}
44322024-10-19T04:19:15.630ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
44332024-10-19T04:19:15.630ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44342024-10-19T04:19:15.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44352024-10-19T04:19:15.632ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44362024-10-19T04:19:15.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44372024-10-19T04:19:15.635ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44382024-10-19T04:19:15.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44392024-10-19T04:19:15.637ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44402024-10-19T04:19:15.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44412024-10-19T04:19:15.639ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44422024-10-19T04:19:15.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44432024-10-19T04:19:15.641ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44442024-10-19T04:19:15.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44452024-10-19T04:19:15.669ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "32fd731b-9a2a-4ebc-b9fa-7891f18eb787", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
44462024-10-19T04:19:15.669ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 switch = Switch0
44472024-10-19T04:19:15.669ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
44482024-10-19T04:19:15.669ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 7a4ab4db-4586-4060-be07-8fb242636fc1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b86da270-139b-4450-939a-b0e3f21416a7", "content-length": "667", "date": "Sat, 19 Oct 2024 04:19:15 GMT"} })
44492024-10-19T04:19:15.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44502024-10-19T04:19:15.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44512024-10-19T04:19:15.672ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44522024-10-19T04:19:15.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44532024-10-19T04:19:15.675ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44542024-10-19T04:19:15.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44552024-10-19T04:19:15.676ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44562024-10-19T04:19:15.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44572024-10-19T04:19:15.685ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 825.812598ms iteration = 21 status = {}
44582024-10-19T04:19:15.705ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 74.864365ms iteration = 25 status = {"physical_disks_added":0}
44592024-10-19T04:19:16.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9bf68f0a-3485-44d9-ac86-347c1f6a33e1 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
44602024-10-19T04:19:16.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9bf68f0a-3485-44d9-ac86-347c1f6a33e1 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
44612024-10-19T04:19:16.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1886 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 9bf68f0a-3485-44d9-ac86-347c1f6a33e1 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
44622024-10-19T04:19:16.146ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:33049
44632024-10-19T04:19:16.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33049 req_id = 6fbe3a38-705d-428a-b71c-42ae64122f2c roles = RoleSet { roles: {} } uri = /metrics/collectors/d13f4058-195e-4aa0-9be7-8fb20b81649a/producers?sort_by=id_ascending
44642024-10-19T04:19:16.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33049 req_id = 6fbe3a38-705d-428a-b71c-42ae64122f2c resource = Database result = Ok(()) uri = /metrics/collectors/d13f4058-195e-4aa0-9be7-8fb20b81649a/producers?sort_by=id_ascending
44652024-10-19T04:19:16.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2727 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33049 req_id = 6fbe3a38-705d-428a-b71c-42ae64122f2c response_code = 200 uri = /metrics/collectors/d13f4058-195e-4aa0-9be7-8fb20b81649a/producers?sort_by=id_ascending
44662024-10-19T04:19:16.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33049 req_id = ad17649c-84de-4722-8355-96401c8c2532 roles = RoleSet { roles: {} } uri = /metrics/collectors/d13f4058-195e-4aa0-9be7-8fb20b81649a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTI0NTZhOS1jNmUxLTQ0OTMtODYyZS01ZjVlNTA3NDVjNzYifX0%3D
44672024-10-19T04:19:16.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33049 req_id = ad17649c-84de-4722-8355-96401c8c2532 resource = Database result = Ok(()) uri = /metrics/collectors/d13f4058-195e-4aa0-9be7-8fb20b81649a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTI0NTZhOS1jNmUxLTQ0OTMtODYyZS01ZjVlNTA3NDVjNzYifX0%3D
44682024-10-19T04:19:16.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33049 req_id = ad17649c-84de-4722-8355-96401c8c2532 response_code = 200 uri = /metrics/collectors/d13f4058-195e-4aa0-9be7-8fb20b81649a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNTI0NTZhOS1jNmUxLTQ0OTMtODYyZS01ZjVlNTA3NDVjNzYifX0%3D
44692024-10-19T04:19:17.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f113ed2a-5bed-4595-aedf-4ca37c474f2b roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
44702024-10-19T04:19:17.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f113ed2a-5bed-4595-aedf-4ca37c474f2b resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
44712024-10-19T04:19:17.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = f113ed2a-5bed-4595-aedf-4ca37c474f2b response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
44722024-10-19T04:19:17.876ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:47735
44732024-10-19T04:19:17.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47735 req_id = 65d35211-7d4d-4760-9ac9-31b761875827 roles = RoleSet { roles: {} } uri = /metrics/producers
44742024-10-19T04:19:17.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47735 req_id = 65d35211-7d4d-4760-9ac9-31b761875827 resource = Database result = Ok(()) uri = /metrics/producers
44752024-10-19T04:19:17.909ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d13f4058-195e-4aa0-9be7-8fb20b81649a
44762024-10-19T04:19:17.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47735 req_id = 65d35211-7d4d-4760-9ac9-31b761875827 roles = RoleSet { roles: {} } uri = /metrics/producers
44772024-10-19T04:19:17.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47735 req_id = 65d35211-7d4d-4760-9ac9-31b761875827 resource = Database result = Ok(()) uri = /metrics/producers
44782024-10-19T04:19:17.917ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a uri = http://[fd00:1122:3344:101::d]:12223/producers
44792024-10-19T04:19:17.918ZDEBGnexus: client response oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "480d7e87-4375-4eaa-bd0b-5c28cb672240", "date": "Sat, 19 Oct 2024 04:19:17 GMT"} })
44802024-10-19T04:19:17.918ZINFOnexus: assigned collector to new producer collector_id = d13f4058-195e-4aa0-9be7-8fb20b81649a file = nexus/src/app/oximeter.rs:125 producer_id = 8180ea00-0a5e-4377-b19a-82e7e60b09bd
44812024-10-19T04:19:17.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 43253 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47735 req_id = 65d35211-7d4d-4760-9ac9-31b761875827 response_code = 201 uri = /metrics/producers
44822024-10-19T04:19:18.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 411c6833-0758-4628-9e39-d017c05ea835 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
44832024-10-19T04:19:18.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 411c6833-0758-4628-9e39-d017c05ea835 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
44842024-10-19T04:19:18.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 411c6833-0758-4628-9e39-d017c05ea835 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
44852024-10-19T04:19:18.571ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:47723
44862024-10-19T04:19:18.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47723 req_id = a38f08fb-3e6a-49f4-8f1e-4945d1c430b3 roles = RoleSet { roles: {} } uri = /metrics/producers
44872024-10-19T04:19:18.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47723 req_id = a38f08fb-3e6a-49f4-8f1e-4945d1c430b3 resource = Database result = Ok(()) uri = /metrics/producers
44882024-10-19T04:19:18.605ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d13f4058-195e-4aa0-9be7-8fb20b81649a
44892024-10-19T04:19:18.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47723 req_id = a38f08fb-3e6a-49f4-8f1e-4945d1c430b3 roles = RoleSet { roles: {} } uri = /metrics/producers
44902024-10-19T04:19:18.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47723 req_id = a38f08fb-3e6a-49f4-8f1e-4945d1c430b3 resource = Database result = Ok(()) uri = /metrics/producers
44912024-10-19T04:19:18.612ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a uri = http://[fd00:1122:3344:101::d]:12223/producers
44922024-10-19T04:19:18.613ZDEBGnexus: client response oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2ba4d68f-ce1e-4488-8662-c6403ed4616a", "date": "Sat, 19 Oct 2024 04:19:18 GMT"} })
44932024-10-19T04:19:18.613ZINFOnexus: assigned collector to new producer collector_id = d13f4058-195e-4aa0-9be7-8fb20b81649a file = nexus/src/app/oximeter.rs:125 producer_id = 5f76e8b8-af5e-4a08-b5c8-0f54c96da65c
44942024-10-19T04:19:18.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 42082 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47723 req_id = a38f08fb-3e6a-49f4-8f1e-4945d1c430b3 response_code = 201 uri = /metrics/producers
44952024-10-19T04:19:19.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = eb1e0a85-79ea-4341-b846-995915389917 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
44962024-10-19T04:19:19.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = eb1e0a85-79ea-4341-b846-995915389917 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
44972024-10-19T04:19:19.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2364 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = eb1e0a85-79ea-4341-b846-995915389917 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
44982024-10-19T04:19:20.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3fd4c5ac-5a35-4087-ba14-8c8651e7de0d roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
44992024-10-19T04:19:20.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3fd4c5ac-5a35-4087-ba14-8c8651e7de0d resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45002024-10-19T04:19:20.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 3fd4c5ac-5a35-4087-ba14-8c8651e7de0d response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45012024-10-19T04:19:21.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e0966356-a459-44de-885b-54044ec3476d roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45022024-10-19T04:19:21.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e0966356-a459-44de-885b-54044ec3476d resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45032024-10-19T04:19:21.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e0966356-a459-44de-885b-54044ec3476d response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45042024-10-19T04:19:22.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e2eda802-3739-4844-a31c-5420ab807394 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45052024-10-19T04:19:22.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e2eda802-3739-4844-a31c-5420ab807394 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45062024-10-19T04:19:22.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e2eda802-3739-4844-a31c-5420ab807394 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45072024-10-19T04:19:23.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d4789495-21a1-4f4c-8689-3d63b634fc6e roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45082024-10-19T04:19:23.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d4789495-21a1-4f4c-8689-3d63b634fc6e resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45092024-10-19T04:19:23.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d4789495-21a1-4f4c-8689-3d63b634fc6e response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45102024-10-19T04:19:24.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d320a577-1a07-46a1-a555-277a0522025b roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45112024-10-19T04:19:24.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d320a577-1a07-46a1-a555-277a0522025b resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45122024-10-19T04:19:24.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2888 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d320a577-1a07-46a1-a555-277a0522025b response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45132024-10-19T04:19:24.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
45142024-10-19T04:19:24.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45152024-10-19T04:19:24.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
45162024-10-19T04:19:24.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45172024-10-19T04:19:24.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45182024-10-19T04:19:24.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45192024-10-19T04:19:24.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45202024-10-19T04:19:24.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45212024-10-19T04:19:24.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45222024-10-19T04:19:24.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.867056ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45232024-10-19T04:19:24.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45242024-10-19T04:19:24.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45252024-10-19T04:19:24.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45262024-10-19T04:19:24.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45272024-10-19T04:19:24.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45282024-10-19T04:19:24.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45292024-10-19T04:19:24.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
45302024-10-19T04:19:24.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45312024-10-19T04:19:24.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45322024-10-19T04:19:24.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
45332024-10-19T04:19:24.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.804952ms iteration = 62 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
45342024-10-19T04:19:25.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 459f39b2-4d06-4bb0-936f-18ef5d6c80a7 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45352024-10-19T04:19:25.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 459f39b2-4d06-4bb0-936f-18ef5d6c80a7 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45362024-10-19T04:19:25.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1903 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 459f39b2-4d06-4bb0-936f-18ef5d6c80a7 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45372024-10-19T04:19:26.168ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1852 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = d1f66f3e-b3d8-4fc1-9ccb-371f302abc59 response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
45382024-10-19T04:19:26.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d46509d7-deb0-4b39-ad77-76234485df38 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45392024-10-19T04:19:26.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d46509d7-deb0-4b39-ad77-76234485df38 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45402024-10-19T04:19:26.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = d46509d7-deb0-4b39-ad77-76234485df38 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45412024-10-19T04:19:26.435ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:50085
45422024-10-19T04:19:26.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50085 req_id = 47e43f3b-de1c-4941-9632-a39e04e3f2d7 roles = RoleSet { roles: {} } uri = /metrics/producers
45432024-10-19T04:19:26.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50085 req_id = 47e43f3b-de1c-4941-9632-a39e04e3f2d7 resource = Database result = Ok(()) uri = /metrics/producers
45442024-10-19T04:19:26.468ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d13f4058-195e-4aa0-9be7-8fb20b81649a
45452024-10-19T04:19:26.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50085 req_id = 47e43f3b-de1c-4941-9632-a39e04e3f2d7 roles = RoleSet { roles: {} } uri = /metrics/producers
45462024-10-19T04:19:26.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50085 req_id = 47e43f3b-de1c-4941-9632-a39e04e3f2d7 resource = Database result = Ok(()) uri = /metrics/producers
45472024-10-19T04:19:26.473ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a uri = http://[fd00:1122:3344:101::d]:12223/producers
45482024-10-19T04:19:26.473ZDEBGnexus: client response oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2b5ea2b8-226d-494e-915d-6717e2763343", "date": "Sat, 19 Oct 2024 04:19:26 GMT"} })
45492024-10-19T04:19:26.473ZINFOnexus: assigned collector to new producer collector_id = d13f4058-195e-4aa0-9be7-8fb20b81649a file = nexus/src/app/oximeter.rs:125 producer_id = caba0976-5752-4cbc-b847-8d7f065750bc
45502024-10-19T04:19:26.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 39016 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50085 req_id = 47e43f3b-de1c-4941-9632-a39e04e3f2d7 response_code = 201 uri = /metrics/producers
45512024-10-19T04:19:26.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 9317b1aa-63ff-45ba-9543-08b5a852963e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
45522024-10-19T04:19:26.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 9317b1aa-63ff-45ba-9543-08b5a852963e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
45532024-10-19T04:19:26.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56930 req_id = 9317b1aa-63ff-45ba-9543-08b5a852963e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
45542024-10-19T04:19:27.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 357793f1-84d0-4cff-8604-3b01194a6166 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45552024-10-19T04:19:27.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 357793f1-84d0-4cff-8604-3b01194a6166 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45562024-10-19T04:19:27.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2936 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 357793f1-84d0-4cff-8604-3b01194a6166 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45572024-10-19T04:19:28.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 45ee2e6f-69ba-4bd9-89e3-aedcb5790264 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45582024-10-19T04:19:28.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 45ee2e6f-69ba-4bd9-89e3-aedcb5790264 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45592024-10-19T04:19:28.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 45ee2e6f-69ba-4bd9-89e3-aedcb5790264 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45602024-10-19T04:19:28.546ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:35206
45612024-10-19T04:19:28.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35206 req_id = 7eb54096-3f3c-4287-848a-e8c44b1fc617 roles = RoleSet { roles: {} } uri = /metrics/producers
45622024-10-19T04:19:28.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35206 req_id = 7eb54096-3f3c-4287-848a-e8c44b1fc617 resource = Database result = Ok(()) uri = /metrics/producers
45632024-10-19T04:19:28.579ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d13f4058-195e-4aa0-9be7-8fb20b81649a
45642024-10-19T04:19:28.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35206 req_id = 7eb54096-3f3c-4287-848a-e8c44b1fc617 roles = RoleSet { roles: {} } uri = /metrics/producers
45652024-10-19T04:19:28.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35206 req_id = 7eb54096-3f3c-4287-848a-e8c44b1fc617 resource = Database result = Ok(()) uri = /metrics/producers
45662024-10-19T04:19:28.586ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a uri = http://[fd00:1122:3344:101::d]:12223/producers
45672024-10-19T04:19:28.586ZDEBGnexus: client response oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "39184d71-35ac-4ba4-b9be-8f333297330c", "date": "Sat, 19 Oct 2024 04:19:28 GMT"} })
45682024-10-19T04:19:28.586ZINFOnexus: assigned collector to new producer collector_id = d13f4058-195e-4aa0-9be7-8fb20b81649a file = nexus/src/app/oximeter.rs:125 producer_id = 1b5ec442-9210-4f04-ad14-bad1f75b3b07
45692024-10-19T04:19:28.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 40895 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35206 req_id = 7eb54096-3f3c-4287-848a-e8c44b1fc617 response_code = 201 uri = /metrics/producers
45702024-10-19T04:19:29.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1bc071f6-1d9c-4946-873f-baecb0de0e8c roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45712024-10-19T04:19:29.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1bc071f6-1d9c-4946-873f-baecb0de0e8c resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45722024-10-19T04:19:29.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2473 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1bc071f6-1d9c-4946-873f-baecb0de0e8c response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45732024-10-19T04:19:30.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 99b21468-8a7d-426d-9dc2-43f7ac2e9018 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45742024-10-19T04:19:30.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 99b21468-8a7d-426d-9dc2-43f7ac2e9018 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45752024-10-19T04:19:30.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2825 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 99b21468-8a7d-426d-9dc2-43f7ac2e9018 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45762024-10-19T04:19:31.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1233f434-0db7-432a-a1f3-67d3ca501ef7 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45772024-10-19T04:19:31.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1233f434-0db7-432a-a1f3-67d3ca501ef7 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45782024-10-19T04:19:31.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2938 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 1233f434-0db7-432a-a1f3-67d3ca501ef7 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45792024-10-19T04:19:31.815ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:62905
45802024-10-19T04:19:31.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62905 req_id = 826207e3-f4d1-42f4-aab4-965fe3e0e0f6 roles = RoleSet { roles: {} } uri = /metrics/producers
45812024-10-19T04:19:31.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62905 req_id = 826207e3-f4d1-42f4-aab4-965fe3e0e0f6 resource = Database result = Ok(()) uri = /metrics/producers
45822024-10-19T04:19:31.848ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d13f4058-195e-4aa0-9be7-8fb20b81649a
45832024-10-19T04:19:31.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62905 req_id = 826207e3-f4d1-42f4-aab4-965fe3e0e0f6 roles = RoleSet { roles: {} } uri = /metrics/producers
45842024-10-19T04:19:31.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62905 req_id = 826207e3-f4d1-42f4-aab4-965fe3e0e0f6 resource = Database result = Ok(()) uri = /metrics/producers
45852024-10-19T04:19:31.853ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a uri = http://[fd00:1122:3344:101::d]:12223/producers
45862024-10-19T04:19:31.853ZDEBGnexus: client response oximeter-collector = d13f4058-195e-4aa0-9be7-8fb20b81649a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "44d09123-74d7-4373-96a2-5c4f417fef1f", "date": "Sat, 19 Oct 2024 04:19:31 GMT"} })
45872024-10-19T04:19:31.853ZINFOnexus: assigned collector to new producer collector_id = d13f4058-195e-4aa0-9be7-8fb20b81649a file = nexus/src/app/oximeter.rs:125 producer_id = 58100a28-9c4f-46bc-93e2-df5bdfc31441
45882024-10-19T04:19:31.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 38875 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62905 req_id = 826207e3-f4d1-42f4-aab4-965fe3e0e0f6 response_code = 201 uri = /metrics/producers
45892024-10-19T04:19:32.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ab6115cc-3f17-41c5-b1ef-e0815e3bcf00 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45902024-10-19T04:19:32.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ab6115cc-3f17-41c5-b1ef-e0815e3bcf00 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45912024-10-19T04:19:32.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ab6115cc-3f17-41c5-b1ef-e0815e3bcf00 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45922024-10-19T04:19:33.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ea7fbf55-fb95-4c18-ac00-a95a10f10b75 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45932024-10-19T04:19:33.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ea7fbf55-fb95-4c18-ac00-a95a10f10b75 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45942024-10-19T04:19:33.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2488 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = ea7fbf55-fb95-4c18-ac00-a95a10f10b75 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45952024-10-19T04:19:34.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2ebc5f1b-77cf-4308-a8da-f532e3ab2a09 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45962024-10-19T04:19:34.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2ebc5f1b-77cf-4308-a8da-f532e3ab2a09 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45972024-10-19T04:19:34.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 2ebc5f1b-77cf-4308-a8da-f532e3ab2a09 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
45982024-10-19T04:19:34.859ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
45992024-10-19T04:19:34.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46002024-10-19T04:19:34.859ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
46012024-10-19T04:19:34.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46022024-10-19T04:19:34.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46032024-10-19T04:19:34.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46042024-10-19T04:19:34.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46052024-10-19T04:19:34.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46062024-10-19T04:19:34.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46072024-10-19T04:19:34.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.447608ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46082024-10-19T04:19:34.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46092024-10-19T04:19:34.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46102024-10-19T04:19:34.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46112024-10-19T04:19:34.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46122024-10-19T04:19:34.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46132024-10-19T04:19:34.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46142024-10-19T04:19:34.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 17bed7cd-3cc8-42ee-823c-666aaabff931, lookup_type: ById(17bed7cd-3cc8-42ee-823c-666aaabff931) } result = Ok(())
46152024-10-19T04:19:34.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46162024-10-19T04:19:34.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46172024-10-19T04:19:34.874ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 original_time_created = 2024-10-19 04:09:04.945212 UTC target_id = 17bed7cd-3cc8-42ee-823c-666aaabff931 time_created = 2024-10-19 04:09:04.945212 UTC
46182024-10-19T04:19:34.874ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.389133ms iteration = 63 status = {"status":"target blueprint unchanged","target_id":"17bed7cd-3cc8-42ee-823c-666aaabff931","time_created":"2024-10-19T04:09:04.945212Z"}
46192024-10-19T04:19:35.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 90c8bbc2-e4fe-4420-a00f-795bef8d606d roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
46202024-10-19T04:19:35.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 90c8bbc2-e4fe-4420-a00f-795bef8d606d resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
46212024-10-19T04:19:35.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1921 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 90c8bbc2-e4fe-4420-a00f-795bef8d606d response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
46222024-10-19T04:19:36.166ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1634 local_addr = [fd00:1122:3344:101::b]:34667 method = GET remote_addr = [fd00:1122:3344:101::d]:56595 req_id = 72f92bcf-1dad-435c-840e-726077bb3c2b response_code = 200 uri = /613e815e-cc58-43ed-80bc-ffd165040e7b
46232024-10-19T04:19:36.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 28b2410f-98da-4587-ace9-285ce7e9e61b roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
46242024-10-19T04:19:36.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 28b2410f-98da-4587-ace9-285ce7e9e61b resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
46252024-10-19T04:19:36.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 28b2410f-98da-4587-ace9-285ce7e9e61b response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
46262024-10-19T04:19:37.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 34c5d205-d81d-452b-91ea-0ed597f7e225 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
46272024-10-19T04:19:37.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 34c5d205-d81d-452b-91ea-0ed597f7e225 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
46282024-10-19T04:19:37.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = 34c5d205-d81d-452b-91ea-0ed597f7e225 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
46292024-10-19T04:19:38.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e7ee6d5c-bc9e-412b-a6d9-0d07fec090ae roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
46302024-10-19T04:19:38.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e7ee6d5c-bc9e-412b-a6d9-0d07fec090ae resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
46312024-10-19T04:19:38.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2552 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e7ee6d5c-bc9e-412b-a6d9-0d07fec090ae response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
46322024-10-19T04:19:39.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = c7a5d94f-0a34-425a-bfea-ec75d14eb183 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
46332024-10-19T04:19:39.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = c7a5d94f-0a34-425a-bfea-ec75d14eb183 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
46342024-10-19T04:19:39.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3241 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = c7a5d94f-0a34-425a-bfea-ec75d14eb183 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
46352024-10-19T04:19:40.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e78b8895-bba1-4f15-9be1-2b6c6164a9b3 roles = RoleSet { roles: {} } uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
46362024-10-19T04:19:40.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e78b8895-bba1-4f15-9be1-2b6c6164a9b3 resource = Database result = Ok(()) uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd
46372024-10-19T04:19:40.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56868 req_id = e78b8895-bba1-4f15-9be1-2b6c6164a9b3 response_code = 200 uri = /probes/8180ea00-0a5e-4377-b19a-82e7e60b09bd