Max level shown:
12024-12-20T21:30:03.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c0038d2d-66df-4125-9d08-91e828091b2e roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
22024-12-20T21:30:03.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c0038d2d-66df-4125-9d08-91e828091b2e resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
32024-12-20T21:30:03.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c0038d2d-66df-4125-9d08-91e828091b2e response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
42024-12-20T21:30:04.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a3335ce3-ce33-48e6-8ebd-6f77fcc33a81 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
52024-12-20T21:30:04.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a3335ce3-ce33-48e6-8ebd-6f77fcc33a81 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
62024-12-20T21:30:04.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1905 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a3335ce3-ce33-48e6-8ebd-6f77fcc33a81 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
72024-12-20T21:30:05.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f8561185-172b-4635-9fcd-ab263d38ce36 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
82024-12-20T21:30:05.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f8561185-172b-4635-9fcd-ab263d38ce36 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
92024-12-20T21:30:05.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2763 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f8561185-172b-4635-9fcd-ab263d38ce36 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
102024-12-20T21:30:06.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e03ff112-3a09-4ecb-935b-eb550144988b roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
112024-12-20T21:30:06.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e03ff112-3a09-4ecb-935b-eb550144988b resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
122024-12-20T21:30:06.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e03ff112-3a09-4ecb-935b-eb550144988b response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
132024-12-20T21:30:06.405ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 762 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = c59b1176-7aa4-44f8-ba10-8c12319880ad response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
142024-12-20T21:30:07.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 89173516-30fc-4952-b38a-53a4b2eb191b roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
152024-12-20T21:30:07.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 89173516-30fc-4952-b38a-53a4b2eb191b resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
162024-12-20T21:30:07.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2672 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 89173516-30fc-4952-b38a-53a4b2eb191b response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
172024-12-20T21:30:08.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ff77fa91-4e9b-483c-a2ba-bd7e3a3f6ba0 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
182024-12-20T21:30:08.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ff77fa91-4e9b-483c-a2ba-bd7e3a3f6ba0 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
192024-12-20T21:30:08.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ff77fa91-4e9b-483c-a2ba-bd7e3a3f6ba0 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
202024-12-20T21:30:09.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5ecbdd3f-2129-44fc-81d4-a83d6bcf1986 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
212024-12-20T21:30:09.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5ecbdd3f-2129-44fc-81d4-a83d6bcf1986 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
222024-12-20T21:30:09.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5ecbdd3f-2129-44fc-81d4-a83d6bcf1986 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
232024-12-20T21:30:09.537ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
242024-12-20T21:30:09.537ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
252024-12-20T21:30:09.537ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
262024-12-20T21:30:09.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
272024-12-20T21:30:09.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
282024-12-20T21:30:09.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
292024-12-20T21:30:09.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
302024-12-20T21:30:09.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
312024-12-20T21:30:09.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
322024-12-20T21:30:09.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.372318ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
332024-12-20T21:30:09.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
342024-12-20T21:30:09.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
352024-12-20T21:30:09.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
362024-12-20T21:30:09.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
372024-12-20T21:30:09.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
382024-12-20T21:30:09.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
392024-12-20T21:30:09.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
402024-12-20T21:30:09.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
412024-12-20T21:30:09.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
422024-12-20T21:30:09.557ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
432024-12-20T21:30:09.557ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.798114ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
442024-12-20T21:30:10.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4007d51a-f211-432c-8782-5ce5ca743cce roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
452024-12-20T21:30:10.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4007d51a-f211-432c-8782-5ce5ca743cce resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
462024-12-20T21:30:10.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4007d51a-f211-432c-8782-5ce5ca743cce response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
472024-12-20T21:30:11.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ab3542a4-a935-4726-98f4-22bea1082cbb roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
482024-12-20T21:30:11.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ab3542a4-a935-4726-98f4-22bea1082cbb resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
492024-12-20T21:30:11.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ab3542a4-a935-4726-98f4-22bea1082cbb response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
502024-12-20T21:30:11.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = 77a6769e-88d0-4bff-8ec0-309cb0b79327 roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
512024-12-20T21:30:11.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = 77a6769e-88d0-4bff-8ec0-309cb0b79327 resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
522024-12-20T21:30:11.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3391 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = 77a6769e-88d0-4bff-8ec0-309cb0b79327 response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
532024-12-20T21:30:11.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = 807fa537-ba43-4a2c-9f66-4b3c35e5d077 roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
542024-12-20T21:30:11.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = 807fa537-ba43-4a2c-9f66-4b3c35e5d077 resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
552024-12-20T21:30:11.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = 807fa537-ba43-4a2c-9f66-4b3c35e5d077 response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
562024-12-20T21:30:12.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8acfd5a5-4ff0-414f-975c-2b3f432c6de5 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
572024-12-20T21:30:12.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8acfd5a5-4ff0-414f-975c-2b3f432c6de5 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
582024-12-20T21:30:12.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8acfd5a5-4ff0-414f-975c-2b3f432c6de5 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
592024-12-20T21:30:13.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e6d8ffd5-e8e0-46d1-a126-620265f7d564 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
602024-12-20T21:30:13.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e6d8ffd5-e8e0-46d1-a126-620265f7d564 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
612024-12-20T21:30:13.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e6d8ffd5-e8e0-46d1-a126-620265f7d564 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
622024-12-20T21:30:14.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d70bc675-4275-43fd-a396-6ea688472357 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
632024-12-20T21:30:14.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d70bc675-4275-43fd-a396-6ea688472357 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
642024-12-20T21:30:14.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d70bc675-4275-43fd-a396-6ea688472357 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
652024-12-20T21:30:15.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a3885332-5bc2-4696-b0b3-9daf6673d846 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
662024-12-20T21:30:15.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a3885332-5bc2-4696-b0b3-9daf6673d846 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
672024-12-20T21:30:15.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2624 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a3885332-5bc2-4696-b0b3-9daf6673d846 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
682024-12-20T21:30:16.405ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 576 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 1c8281d1-8d36-4996-9e30-e1a6e32a5494 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
692024-12-20T21:30:16.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5a69494a-26b2-496b-81db-bd4f430ce5a5 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
702024-12-20T21:30:16.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5a69494a-26b2-496b-81db-bd4f430ce5a5 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
712024-12-20T21:30:16.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1595 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5a69494a-26b2-496b-81db-bd4f430ce5a5 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
722024-12-20T21:30:17.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7ed06769-58ad-4e75-8980-11dbeabed757 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
732024-12-20T21:30:17.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7ed06769-58ad-4e75-8980-11dbeabed757 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
742024-12-20T21:30:17.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7ed06769-58ad-4e75-8980-11dbeabed757 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
752024-12-20T21:30:18.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 44cf4f3a-737e-4d17-a5e3-634666768e41 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
762024-12-20T21:30:18.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 44cf4f3a-737e-4d17-a5e3-634666768e41 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
772024-12-20T21:30:18.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 44cf4f3a-737e-4d17-a5e3-634666768e41 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
782024-12-20T21:30:19.538ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
792024-12-20T21:30:19.538ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
802024-12-20T21:30:19.538ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
812024-12-20T21:30:19.538ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
822024-12-20T21:30:19.538ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
832024-12-20T21:30:19.538ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
842024-12-20T21:30:19.538ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
852024-12-20T21:30:19.539ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
862024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
872024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
882024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
892024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
902024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
912024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
922024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
932024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
942024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
952024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
962024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
972024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
982024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
992024-12-20T21:30:19.539ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 21:20:19.539042818 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1002024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1012024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
1022024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1032024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
1042024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1052024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
1062024-12-20T21:30:19.539ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9112287e-7109-46ca-aa8a-610048d83c82
1072024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
1082024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.17\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"9112287e-7109-46ca-aa8a-610048d83c82"}
1092024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
1102024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
1112024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1122024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
1132024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1142024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
1152024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1162024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
1172024-12-20T21:30:19.539ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1182024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
1192024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1202024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1212024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
1222024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1232024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
1242024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
1252024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1262024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
1272024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1282024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
1292024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1302024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
1312024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1322024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
1332024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
1342024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
1352024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1362024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1372024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1382024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
1392024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1402024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1412024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1422024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1432024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1442024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1452024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1462024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1472024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1482024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1492024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
1502024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1512024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1522024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1532024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1542024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1552024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1562024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1572024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1582024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1592024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1602024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1612024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1622024-12-20T21:30:19.539ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("065cea45-0eca-4287-90a0-2c3c20ec32f8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b24cb173-c3a3-4237-abe6-0e7953a415e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b24cb173-c3a3-4237-abe6-0e7953a415e5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1318, tv_nsec: 819902806 } })
1632024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1642024-12-20T21:30:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1652024-12-20T21:30:19.540ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4565f09e-ee63-469d-bb6e-3ccd4abd01fe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("73abfaca-4f35-4f97-9980-1890d6dba8fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3f6b067-d10e-44b3-9f21-f8e5a96a2b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3f6b067-d10e-44b3-9f21-f8e5a96a2b37.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1318, tv_nsec: 820086970 } })
1662024-12-20T21:30:19.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1672024-12-20T21:30:19.540ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
1682024-12-20T21:30:19.540ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.077234ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
1692024-12-20T21:30:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1702024-12-20T21:30:19.540ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
1712024-12-20T21:30:19.540ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.236058ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
1722024-12-20T21:30:19.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1732024-12-20T21:30:19.542ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1742024-12-20T21:30:19.542ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1752024-12-20T21:30:19.542ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.867947ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1762024-12-20T21:30:19.544ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 21:20:19.539042818 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
1772024-12-20T21:30:19.544ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.139085ms iteration = 9 status = {"expiration":"2024-12-20T21:20:19.539042818Z","pruned":[]}
1782024-12-20T21:30:19.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1792024-12-20T21:30:19.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1802024-12-20T21:30:19.545ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
1812024-12-20T21:30:19.545ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1822024-12-20T21:30:19.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1832024-12-20T21:30:19.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1842024-12-20T21:30:19.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
1852024-12-20T21:30:19.545ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1862024-12-20T21:30:19.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1872024-12-20T21:30:19.547ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.305337ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
1882024-12-20T21:30:19.548ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1892024-12-20T21:30:19.548ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1902024-12-20T21:30:19.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1912024-12-20T21:30:19.549ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.909082ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
1922024-12-20T21:30:19.549ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.594968ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
1932024-12-20T21:30:19.549ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
1942024-12-20T21:30:19.549ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
1952024-12-20T21:30:19.549ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 10.584988ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
1962024-12-20T21:30:19.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1972024-12-20T21:30:19.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1982024-12-20T21:30:19.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1992024-12-20T21:30:19.550ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1318, tv_nsec: 831035696 } })
2002024-12-20T21:30:19.551ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
2012024-12-20T21:30:19.553ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2022024-12-20T21:30:19.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1f105b44-2eef-4a6c-9c1c-0b70cacd1afc roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
2032024-12-20T21:30:19.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1f105b44-2eef-4a6c-9c1c-0b70cacd1afc resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
2042024-12-20T21:30:19.553ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2052024-12-20T21:30:19.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2062024-12-20T21:30:19.554ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2072024-12-20T21:30:19.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2082024-12-20T21:30:19.555ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1318, tv_nsec: 835604098 } })
2092024-12-20T21:30:19.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2102024-12-20T21:30:19.556ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2112024-12-20T21:30:19.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2122024-12-20T21:30:19.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2132024-12-20T21:30:19.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2142024-12-20T21:30:19.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2152024-12-20T21:30:19.558ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
2162024-12-20T21:30:19.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2172024-12-20T21:30:19.558ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2182024-12-20T21:30:19.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2192024-12-20T21:30:19.560ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2202024-12-20T21:30:19.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2212024-12-20T21:30:19.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2222024-12-20T21:30:19.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2232024-12-20T21:30:19.564ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2242024-12-20T21:30:19.564ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2252024-12-20T21:30:19.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2262024-12-20T21:30:19.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2272024-12-20T21:30:19.566ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1318, tv_nsec: 846242726 } })
2282024-12-20T21:30:19.566ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
2292024-12-20T21:30:19.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1f105b44-2eef-4a6c-9c1c-0b70cacd1afc response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
2302024-12-20T21:30:19.567ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2312024-12-20T21:30:19.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2322024-12-20T21:30:19.575ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2332024-12-20T21:30:19.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2342024-12-20T21:30:19.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
2352024-12-20T21:30:19.580ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2362024-12-20T21:30:19.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2372024-12-20T21:30:19.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2382024-12-20T21:30:19.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2392024-12-20T21:30:19.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
2402024-12-20T21:30:19.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2412024-12-20T21:30:19.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2422024-12-20T21:30:19.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2432024-12-20T21:30:19.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2442024-12-20T21:30:19.583ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2452024-12-20T21:30:19.586ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2462024-12-20T21:30:19.586ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2472024-12-20T21:30:19.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2482024-12-20T21:30:19.587ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2492024-12-20T21:30:19.587ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2502024-12-20T21:30:19.587ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2512024-12-20T21:30:19.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2522024-12-20T21:30:19.589ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2532024-12-20T21:30:19.591ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2542024-12-20T21:30:19.591ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2552024-12-20T21:30:19.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2562024-12-20T21:30:19.594ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2572024-12-20T21:30:19.596ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2582024-12-20T21:30:19.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2592024-12-20T21:30:19.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2602024-12-20T21:30:19.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2612024-12-20T21:30:19.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2622024-12-20T21:30:19.598ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
2632024-12-20T21:30:19.598ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 59.992726ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
2642024-12-20T21:30:19.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2652024-12-20T21:30:19.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2662024-12-20T21:30:19.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2672024-12-20T21:30:19.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2682024-12-20T21:30:19.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2692024-12-20T21:30:19.607ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2702024-12-20T21:30:19.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2712024-12-20T21:30:19.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2722024-12-20T21:30:19.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2732024-12-20T21:30:19.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2742024-12-20T21:30:19.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2752024-12-20T21:30:19.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2762024-12-20T21:30:19.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.738769ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2772024-12-20T21:30:19.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2782024-12-20T21:30:19.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2792024-12-20T21:30:19.612ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
2802024-12-20T21:30:19.612ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
2812024-12-20T21:30:19.612ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 73.543129ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
2822024-12-20T21:30:19.617ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2832024-12-20T21:30:19.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2842024-12-20T21:30:19.618ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2852024-12-20T21:30:19.620ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2862024-12-20T21:30:19.620ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2872024-12-20T21:30:19.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2882024-12-20T21:30:19.623ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2892024-12-20T21:30:19.623ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2902024-12-20T21:30:19.623ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2912024-12-20T21:30:19.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2922024-12-20T21:30:19.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2932024-12-20T21:30:19.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2942024-12-20T21:30:19.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 88.73895ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
2952024-12-20T21:30:19.628ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2962024-12-20T21:30:19.628ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 88.718769ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2972024-12-20T21:30:19.629ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 90.298365ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2982024-12-20T21:30:19.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 97.145819ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2992024-12-20T21:30:19.640ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3002024-12-20T21:30:19.642ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3012024-12-20T21:30:19.642ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3022024-12-20T21:30:19.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3032024-12-20T21:30:19.644ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 105.127877ms iteration = 19 status = {"physical_disks_added":0}
3042024-12-20T21:30:19.644ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
3052024-12-20T21:30:19.644ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
3062024-12-20T21:30:19.644ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
3072024-12-20T21:30:19.644ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3082024-12-20T21:30:19.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3092024-12-20T21:30:19.645ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
3102024-12-20T21:30:19.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
3112024-12-20T21:30:19.646ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3122024-12-20T21:30:19.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3132024-12-20T21:30:19.649ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3142024-12-20T21:30:19.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3152024-12-20T21:30:19.651ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3162024-12-20T21:30:19.651ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c58feff7-51f2-445e-83fd-a0c3a102f4ed dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3172024-12-20T21:30:19.651ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3182024-12-20T21:30:19.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3192024-12-20T21:30:19.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3202024-12-20T21:30:19.653ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3212024-12-20T21:30:19.656ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3222024-12-20T21:30:19.656ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3232024-12-20T21:30:19.656ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 117.619498ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3242024-12-20T21:30:19.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3252024-12-20T21:30:19.657ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3262024-12-20T21:30:19.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c74ff24-982c-40fd-86fd-ef04898c5922, lookup_type: ById(8c74ff24-982c-40fd-86fd-ef04898c5922) } result = Ok(())
3272024-12-20T21:30:19.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3282024-12-20T21:30:19.657ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3292024-12-20T21:30:19.657ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
3302024-12-20T21:30:19.657ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
3312024-12-20T21:30:19.657ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
3322024-12-20T21:30:19.657ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3332024-12-20T21:30:19.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3342024-12-20T21:30:19.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3352024-12-20T21:30:19.659ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c58feff7-51f2-445e-83fd-a0c3a102f4ed dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
3362024-12-20T21:30:19.659ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3372024-12-20T21:30:19.659ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 21:23:04.517297 UTC dns_group = internal generation = 1
3382024-12-20T21:30:19.659ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 120.3877ms iteration = 9 status = {"generation":1}
3392024-12-20T21:30:19.684ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T21:22:10.640928Z, time_modified: 2024-12-20T21:22:10.640928Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, db_silo: Silo { identity: SiloIdentity { id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T21:23:05.471312Z, time_modified: 2024-12-20T21:23:05.471312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, db_silo: Silo { identity: SiloIdentity { id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T21:23:05.471312Z, time_modified: 2024-12-20T21:23:05.471312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b" }] }) }
3402024-12-20T21:30:19.684ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 145.147515ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"66e8bce1-b95a-4433-886f-e35fda6d9a14","tls_certs":["4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b"]}},"default_endpoint":{"silo_id":"66e8bce1-b95a-4433-886f-e35fda6d9a14","tls_certs":["4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
3412024-12-20T21:30:19.690ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
3422024-12-20T21:30:19.703ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
3432024-12-20T21:30:19.704ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
3442024-12-20T21:30:19.704ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 164.870617ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
3452024-12-20T21:30:19.804ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
3462024-12-20T21:30:19.804ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3472024-12-20T21:30:19.805ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b946be38-478c-45a1-b273-646cc8fdabaf", "content-length": "26", "date": "Fri, 20 Dec 2024 21:30:19 GMT"} })
3482024-12-20T21:30:19.805ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3492024-12-20T21:30:19.806ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3502024-12-20T21:30:19.877ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
3512024-12-20T21:30:19.877ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3522024-12-20T21:30:19.877ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "306cdfcf-58f6-4d18-a7e6-eeb0533f6a50", "content-length": "26", "date": "Fri, 20 Dec 2024 21:30:19 GMT"} })
3532024-12-20T21:30:19.877ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3542024-12-20T21:30:19.879ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3552024-12-20T21:30:19.897ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3562024-12-20T21:30:19.898ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2a08c6e-8578-4c62-aa3e-1a755003413c", "content-length": "691", "date": "Fri, 20 Dec 2024 21:30:19 GMT"} })
3572024-12-20T21:30:19.898ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
3582024-12-20T21:30:19.898ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
3592024-12-20T21:30:19.898ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
3602024-12-20T21:30:19.899ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 360.469242ms iteration = 17 status = {}
3612024-12-20T21:30:19.916ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac zone_address = fd00:1122:3344:101::2
3622024-12-20T21:30:19.916ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3632024-12-20T21:30:19.917ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "044ab3e3-a926-474a-9bfb-87bcc3b2fc77", "content-length": "26", "date": "Fri, 20 Dec 2024 21:30:19 GMT"} })
3642024-12-20T21:30:19.917ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3652024-12-20T21:30:19.922ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
3662024-12-20T21:30:19.927ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
3672024-12-20T21:30:19.927ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7acd47eb-3c10-4813-af71-b106420fa971", "date": "Fri, 20 Dec 2024 21:30:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3682024-12-20T21:30:19.927ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3692024-12-20T21:30:19.929ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "92a5c446-4aed-4e8e-bece-4b55f5947514", "date": "Fri, 20 Dec 2024 21:30:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3702024-12-20T21:30:19.929ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3712024-12-20T21:30:19.930ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3722024-12-20T21:30:19.930ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 391.787945ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
3732024-12-20T21:30:19.931ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
3742024-12-20T21:30:19.932ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
3752024-12-20T21:30:19.932ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3762024-12-20T21:30:19.933ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "acd94906-a265-418a-90d9-dcb8f482e5e6", "content-length": "372", "date": "Fri, 20 Dec 2024 21:30:19 GMT"} })
3772024-12-20T21:30:19.933ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3782024-12-20T21:30:19.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3792024-12-20T21:30:19.934ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3802024-12-20T21:30:19.935ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 396.629003ms iteration = 17 status = 0
3812024-12-20T21:30:19.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3822024-12-20T21:30:19.937ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3832024-12-20T21:30:19.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3842024-12-20T21:30:19.979ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3852024-12-20T21:30:19.979ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4aec9cd8-ad86-40dc-bdd7-2394e3237b38 dns_zone_name = oxide.test found_so_far = 0 version = 2
3862024-12-20T21:30:19.979ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3872024-12-20T21:30:19.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3882024-12-20T21:30:19.982ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3892024-12-20T21:30:19.986ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3902024-12-20T21:30:19.986ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3912024-12-20T21:30:19.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3922024-12-20T21:30:19.988ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4aec9cd8-ad86-40dc-bdd7-2394e3237b38 dns_zone_name = oxide.test found_so_far = 1 version = 2
3932024-12-20T21:30:19.988ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
3942024-12-20T21:30:19.988ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 21:23:05.526309 UTC dns_group = external generation = 2
3952024-12-20T21:30:19.988ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 449.204102ms iteration = 9 status = {"generation":2}
3962024-12-20T21:30:20.014ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
3972024-12-20T21:30:20.014ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
3982024-12-20T21:30:20.014ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4ee0bea8-7f99-4aef-abed-5737f5e6c365", "date": "Fri, 20 Dec 2024 21:30:19 GMT"} })
3992024-12-20T21:30:20.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4002024-12-20T21:30:20.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4012024-12-20T21:30:20.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4022024-12-20T21:30:20.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4032024-12-20T21:30:20.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4042024-12-20T21:30:20.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4052024-12-20T21:30:20.026ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4062024-12-20T21:30:20.026ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4072024-12-20T21:30:20.026ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5df3ea25-b700-4243-a234-8cc30dbadcea", "date": "Fri, 20 Dec 2024 21:30:19 GMT"} })
4082024-12-20T21:30:20.028ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 489.425684ms iteration = 17 status = {}
4092024-12-20T21:30:20.032ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4102024-12-20T21:30:20.033ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9af7cf5c-4b04-4bc3-99ce-65fd81ff429f", "content-length": "1", "date": "Fri, 20 Dec 2024 21:30:19 GMT"} })
4112024-12-20T21:30:20.034ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4122024-12-20T21:30:20.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4132024-12-20T21:30:20.037ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 498.012707ms iteration = 17 status = null
4142024-12-20T21:30:20.083ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 544.285954ms iteration = 17 status = {}
4152024-12-20T21:30:20.104ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4162024-12-20T21:30:20.105ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5aceb864-99b3-4787-a07f-a6862d4d5128", "date": "Fri, 20 Dec 2024 21:30:20 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4172024-12-20T21:30:20.105ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4182024-12-20T21:30:20.106ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "109e7412-e81b-45f2-9b08-1b8e85505381", "date": "Fri, 20 Dec 2024 21:30:20 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4192024-12-20T21:30:20.106ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4202024-12-20T21:30:20.107ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "70e2f0b8-9e69-4907-93d8-164cbf00901c", "date": "Fri, 20 Dec 2024 21:30:20 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4212024-12-20T21:30:20.107ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4222024-12-20T21:30:20.109ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4232024-12-20T21:30:20.109ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 570.744798ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4242024-12-20T21:30:20.137ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4252024-12-20T21:30:20.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4262024-12-20T21:30:20.139ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 583388f4-92af-4a10-817c-62f2e9571310, rack_id: a7e68df9-95f5-4fda-aae0-2f46483e29ac, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bacaa666-9eda-4bc8-9ccd-35df228fd476) } rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
4272024-12-20T21:30:20.139ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4282024-12-20T21:30:20.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4292024-12-20T21:30:20.149ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4302024-12-20T21:30:20.149ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2ac6199-94b1-4e2d-9245-6b862c2f2615", "content-length": "134", "date": "Fri, 20 Dec 2024 21:30:19 GMT"} })
4312024-12-20T21:30:20.149ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
4322024-12-20T21:30:20.150ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bacaa666-9eda-4bc8-9ccd-35df228fd476
4332024-12-20T21:30:20.150ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
4342024-12-20T21:30:20.150ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4352024-12-20T21:30:20.150ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4362024-12-20T21:30:20.150ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4372024-12-20T21:30:20.150ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4382024-12-20T21:30:20.150ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4392024-12-20T21:30:20.150ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4402024-12-20T21:30:20.150ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4412024-12-20T21:30:20.150ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
4422024-12-20T21:30:20.150ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4432024-12-20T21:30:20.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4442024-12-20T21:30:20.153ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
4452024-12-20T21:30:20.153ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9835265-69da-4a8d-9e09-9b975e8c6395", "content-length": "2", "date": "Fri, 20 Dec 2024 21:30:19 GMT"} })
4462024-12-20T21:30:20.153ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
4472024-12-20T21:30:20.153ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f2a5eed-aa44-4c4c-8fb9-d1e003f01e5a", "content-length": "52", "date": "Fri, 20 Dec 2024 21:30:19 GMT"} })
4482024-12-20T21:30:20.153ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
4492024-12-20T21:30:20.153ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
4502024-12-20T21:30:20.270ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "36d938e8-df95-479d-a16f-2dc5c0a72a23", "date": "Fri, 20 Dec 2024 21:30:19 GMT"} })
4512024-12-20T21:30:20.270ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch = Switch0
4522024-12-20T21:30:20.270ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
4532024-12-20T21:30:20.270ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "97ab2a5e-2f02-43cd-b3ec-24854f33c92a", "content-length": "682", "date": "Fri, 20 Dec 2024 21:30:19 GMT"} })
4542024-12-20T21:30:20.270ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4552024-12-20T21:30:20.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4562024-12-20T21:30:20.279ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4572024-12-20T21:30:20.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4582024-12-20T21:30:20.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4592024-12-20T21:30:20.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4602024-12-20T21:30:20.285ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4612024-12-20T21:30:20.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4622024-12-20T21:30:20.294ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 754.924548ms iteration = 17 status = {}
4632024-12-20T21:30:20.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 848d6b4f-6a77-4a92-97f7-bbae3eb149cf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
4642024-12-20T21:30:20.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 848d6b4f-6a77-4a92-97f7-bbae3eb149cf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
4652024-12-20T21:30:20.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 848d6b4f-6a77-4a92-97f7-bbae3eb149cf response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
4662024-12-20T21:30:20.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5337945d-9531-45da-b529-a7a2abeea3d1 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4672024-12-20T21:30:20.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5337945d-9531-45da-b529-a7a2abeea3d1 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4682024-12-20T21:30:20.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2745 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5337945d-9531-45da-b529-a7a2abeea3d1 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4692024-12-20T21:30:21.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2a031733-ce0d-41b3-a37c-ce8c126b5867 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4702024-12-20T21:30:21.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2a031733-ce0d-41b3-a37c-ce8c126b5867 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4712024-12-20T21:30:21.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2638 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2a031733-ce0d-41b3-a37c-ce8c126b5867 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4722024-12-20T21:30:22.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3aab29b8-8871-4eaa-9839-f01a24bdbf8d roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4732024-12-20T21:30:22.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3aab29b8-8871-4eaa-9839-f01a24bdbf8d resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4742024-12-20T21:30:22.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3aab29b8-8871-4eaa-9839-f01a24bdbf8d response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4752024-12-20T21:30:23.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = dc6aa1d2-08f0-45bc-9e6f-7c2d760ffc8e roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4762024-12-20T21:30:23.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = dc6aa1d2-08f0-45bc-9e6f-7c2d760ffc8e resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4772024-12-20T21:30:23.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = dc6aa1d2-08f0-45bc-9e6f-7c2d760ffc8e response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4782024-12-20T21:30:24.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d8f63ddf-8655-4ad5-98aa-f650c3e06659 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4792024-12-20T21:30:24.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d8f63ddf-8655-4ad5-98aa-f650c3e06659 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4802024-12-20T21:30:24.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1793 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d8f63ddf-8655-4ad5-98aa-f650c3e06659 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4812024-12-20T21:30:25.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 67b57d3c-0d9b-4b45-9246-6e28f68c651f roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4822024-12-20T21:30:25.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 67b57d3c-0d9b-4b45-9246-6e28f68c651f resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4832024-12-20T21:30:25.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 67b57d3c-0d9b-4b45-9246-6e28f68c651f response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4842024-12-20T21:30:26.405ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 639 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 14433816-06d5-42af-a251-0ec23e9ff3ab response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
4852024-12-20T21:30:26.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4a57910f-ba09-4108-89df-1bd1d433eea7 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4862024-12-20T21:30:26.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4a57910f-ba09-4108-89df-1bd1d433eea7 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4872024-12-20T21:30:26.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4a57910f-ba09-4108-89df-1bd1d433eea7 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4882024-12-20T21:30:27.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b9385a96-9971-46f2-af0e-3328d637f213 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4892024-12-20T21:30:27.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b9385a96-9971-46f2-af0e-3328d637f213 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4902024-12-20T21:30:27.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b9385a96-9971-46f2-af0e-3328d637f213 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4912024-12-20T21:30:28.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6bd88d70-ed98-41f2-a80c-286db087e318 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4922024-12-20T21:30:28.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6bd88d70-ed98-41f2-a80c-286db087e318 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4932024-12-20T21:30:28.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6bd88d70-ed98-41f2-a80c-286db087e318 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
4942024-12-20T21:30:29.538ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
4952024-12-20T21:30:29.538ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4962024-12-20T21:30:29.538ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
4972024-12-20T21:30:29.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4982024-12-20T21:30:29.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4992024-12-20T21:30:29.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5002024-12-20T21:30:29.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5012024-12-20T21:30:29.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5022024-12-20T21:30:29.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5032024-12-20T21:30:29.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5042024-12-20T21:30:29.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5052024-12-20T21:30:29.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5062024-12-20T21:30:29.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5072024-12-20T21:30:29.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
5082024-12-20T21:30:29.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5092024-12-20T21:30:29.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5102024-12-20T21:30:29.561ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
5112024-12-20T21:30:29.561ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.354804ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
5122024-12-20T21:30:29.567ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5132024-12-20T21:30:29.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5142024-12-20T21:30:29.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.339161ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5152024-12-20T21:30:29.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a92adb80-cc57-4609-86ed-eab896b3594b roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5162024-12-20T21:30:29.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a92adb80-cc57-4609-86ed-eab896b3594b resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5172024-12-20T21:30:29.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a92adb80-cc57-4609-86ed-eab896b3594b response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5182024-12-20T21:30:30.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f77acb34-1e35-4ad4-8df6-0a884b1b1306 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5192024-12-20T21:30:30.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f77acb34-1e35-4ad4-8df6-0a884b1b1306 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5202024-12-20T21:30:30.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1952 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f77acb34-1e35-4ad4-8df6-0a884b1b1306 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5212024-12-20T21:30:31.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 74cb13fd-4895-4904-97ae-e82913a0ae52 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5222024-12-20T21:30:31.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 74cb13fd-4895-4904-97ae-e82913a0ae52 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5232024-12-20T21:30:31.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 74cb13fd-4895-4904-97ae-e82913a0ae52 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5242024-12-20T21:30:32.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c256316f-c5f4-4eee-9850-c3b1bac4068a roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5252024-12-20T21:30:32.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c256316f-c5f4-4eee-9850-c3b1bac4068a resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5262024-12-20T21:30:32.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1879 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c256316f-c5f4-4eee-9850-c3b1bac4068a response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5272024-12-20T21:30:33.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 468cd45d-6d0e-449f-9335-8f382327cfe5 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5282024-12-20T21:30:33.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 468cd45d-6d0e-449f-9335-8f382327cfe5 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5292024-12-20T21:30:33.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 468cd45d-6d0e-449f-9335-8f382327cfe5 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5302024-12-20T21:30:34.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a1687b03-e7a1-4218-8ef6-e1ccda459593 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5312024-12-20T21:30:34.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a1687b03-e7a1-4218-8ef6-e1ccda459593 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5322024-12-20T21:30:34.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a1687b03-e7a1-4218-8ef6-e1ccda459593 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5332024-12-20T21:30:35.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d0699b80-6717-4deb-8128-2feff2c6c8ee roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5342024-12-20T21:30:35.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d0699b80-6717-4deb-8128-2feff2c6c8ee resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5352024-12-20T21:30:35.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2662 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d0699b80-6717-4deb-8128-2feff2c6c8ee response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5362024-12-20T21:30:36.404ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 515 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 6805bf1f-13bd-4d3d-bd1b-775ca39c66e3 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
5372024-12-20T21:30:36.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4881cde1-8c04-44dc-b9c1-d8d5c822dc50 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5382024-12-20T21:30:36.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4881cde1-8c04-44dc-b9c1-d8d5c822dc50 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5392024-12-20T21:30:36.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4881cde1-8c04-44dc-b9c1-d8d5c822dc50 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5402024-12-20T21:30:37.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 15a2bbfe-5371-4629-8b88-707d0e7fc6c1 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5412024-12-20T21:30:37.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 15a2bbfe-5371-4629-8b88-707d0e7fc6c1 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5422024-12-20T21:30:37.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 15a2bbfe-5371-4629-8b88-707d0e7fc6c1 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5432024-12-20T21:30:38.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bcfc4b77-7fc1-49fc-94a6-4d6e769ff5d7 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5442024-12-20T21:30:38.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bcfc4b77-7fc1-49fc-94a6-4d6e769ff5d7 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5452024-12-20T21:30:38.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bcfc4b77-7fc1-49fc-94a6-4d6e769ff5d7 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5462024-12-20T21:30:39.538ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
5472024-12-20T21:30:39.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5482024-12-20T21:30:39.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
5492024-12-20T21:30:39.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5502024-12-20T21:30:39.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5512024-12-20T21:30:39.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5522024-12-20T21:30:39.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5532024-12-20T21:30:39.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5542024-12-20T21:30:39.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5552024-12-20T21:30:39.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5562024-12-20T21:30:39.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5572024-12-20T21:30:39.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5582024-12-20T21:30:39.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5592024-12-20T21:30:39.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
5602024-12-20T21:30:39.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5612024-12-20T21:30:39.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5622024-12-20T21:30:39.561ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
5632024-12-20T21:30:39.561ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.857472ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
5642024-12-20T21:30:39.567ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5652024-12-20T21:30:39.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5662024-12-20T21:30:39.569ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.051526ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5672024-12-20T21:30:40.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 65b8b9b8-73d6-4bdc-b23c-f0fdd23a7d74 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5682024-12-20T21:30:40.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 65b8b9b8-73d6-4bdc-b23c-f0fdd23a7d74 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5692024-12-20T21:30:40.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 65b8b9b8-73d6-4bdc-b23c-f0fdd23a7d74 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5702024-12-20T21:30:41.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c4501430-69e1-4924-a8a0-355ba3a32249 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5712024-12-20T21:30:41.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c4501430-69e1-4924-a8a0-355ba3a32249 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5722024-12-20T21:30:41.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c4501430-69e1-4924-a8a0-355ba3a32249 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5732024-12-20T21:30:42.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 22ef416a-df22-4d54-8449-4cea02c38708 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5742024-12-20T21:30:42.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 22ef416a-df22-4d54-8449-4cea02c38708 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5752024-12-20T21:30:42.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 22ef416a-df22-4d54-8449-4cea02c38708 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5762024-12-20T21:30:43.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 25e3136d-5497-475b-82b9-d3abbc5b506b roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5772024-12-20T21:30:43.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 25e3136d-5497-475b-82b9-d3abbc5b506b resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5782024-12-20T21:30:43.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 25e3136d-5497-475b-82b9-d3abbc5b506b response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5792024-12-20T21:30:44.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 39f62003-e12e-49d1-9ebc-1df49833e377 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5802024-12-20T21:30:44.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 39f62003-e12e-49d1-9ebc-1df49833e377 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5812024-12-20T21:30:44.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 39f62003-e12e-49d1-9ebc-1df49833e377 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5822024-12-20T21:30:45.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 667183b1-df00-4033-87bf-527dcd6ea1ae roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5832024-12-20T21:30:45.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 667183b1-df00-4033-87bf-527dcd6ea1ae resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5842024-12-20T21:30:45.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 667183b1-df00-4033-87bf-527dcd6ea1ae response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5852024-12-20T21:30:46.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ad137cbb-f8f5-49f1-b5b1-4afcafd7b9ae roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5862024-12-20T21:30:46.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ad137cbb-f8f5-49f1-b5b1-4afcafd7b9ae resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5872024-12-20T21:30:46.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1928 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ad137cbb-f8f5-49f1-b5b1-4afcafd7b9ae response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5882024-12-20T21:30:46.405ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 540 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 811e32eb-018a-4a52-9489-ed60a21f1841 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
5892024-12-20T21:30:47.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e2943fb6-e914-465e-a965-f9cd4e664f5f roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5902024-12-20T21:30:47.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e2943fb6-e914-465e-a965-f9cd4e664f5f resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5912024-12-20T21:30:47.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e2943fb6-e914-465e-a965-f9cd4e664f5f response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5922024-12-20T21:30:48.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bfad19b1-bce6-4430-af14-e1d13b5d4762 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5932024-12-20T21:30:48.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bfad19b1-bce6-4430-af14-e1d13b5d4762 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5942024-12-20T21:30:48.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bfad19b1-bce6-4430-af14-e1d13b5d4762 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5952024-12-20T21:30:49.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7078e5b5-2d97-4604-8e9b-14a946f089de roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5962024-12-20T21:30:49.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7078e5b5-2d97-4604-8e9b-14a946f089de resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5972024-12-20T21:30:49.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1846 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7078e5b5-2d97-4604-8e9b-14a946f089de response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
5982024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
5992024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6002024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
6012024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6022024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
6032024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6042024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
6052024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
6062024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
6072024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
6082024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
6092024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6102024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
6112024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
6122024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6132024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
6142024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6152024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6162024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
6172024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6182024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
6192024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6202024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
6212024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6222024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
6232024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6242024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
6252024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
6262024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
6272024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6282024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
6292024-12-20T21:30:49.538ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
6302024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6312024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
6322024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6332024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6342024-12-20T21:30:49.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6352024-12-20T21:30:49.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
6362024-12-20T21:30:49.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6372024-12-20T21:30:49.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6382024-12-20T21:30:49.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6392024-12-20T21:30:49.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6402024-12-20T21:30:49.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
6412024-12-20T21:30:49.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6422024-12-20T21:30:49.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6432024-12-20T21:30:49.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
6442024-12-20T21:30:49.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6452024-12-20T21:30:49.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6462024-12-20T21:30:49.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6472024-12-20T21:30:49.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6482024-12-20T21:30:49.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6492024-12-20T21:30:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6502024-12-20T21:30:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6512024-12-20T21:30:49.542ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.887067ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6522024-12-20T21:30:49.542ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6532024-12-20T21:30:49.542ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6542024-12-20T21:30:49.542ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6552024-12-20T21:30:49.542ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6562024-12-20T21:30:49.542ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6572024-12-20T21:30:49.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6582024-12-20T21:30:49.544ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6592024-12-20T21:30:49.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6602024-12-20T21:30:49.544ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6612024-12-20T21:30:49.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6622024-12-20T21:30:49.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6632024-12-20T21:30:49.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6642024-12-20T21:30:49.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6652024-12-20T21:30:49.545ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6662024-12-20T21:30:49.546ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6672024-12-20T21:30:49.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6682024-12-20T21:30:49.546ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1348, tv_nsec: 826130432 } })
6692024-12-20T21:30:49.546ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
6702024-12-20T21:30:49.547ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1348, tv_nsec: 827123214 } })
6712024-12-20T21:30:49.547ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
6722024-12-20T21:30:49.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6732024-12-20T21:30:49.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6742024-12-20T21:30:49.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6752024-12-20T21:30:49.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6762024-12-20T21:30:49.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6772024-12-20T21:30:49.553ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6782024-12-20T21:30:49.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6792024-12-20T21:30:49.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6802024-12-20T21:30:49.556ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6812024-12-20T21:30:49.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6822024-12-20T21:30:49.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 40.787854ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
6832024-12-20T21:30:49.585ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.001454ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
6842024-12-20T21:30:49.586ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6852024-12-20T21:30:49.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6862024-12-20T21:30:49.589ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 50.83491ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6872024-12-20T21:30:49.592ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6882024-12-20T21:30:49.593ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6892024-12-20T21:30:49.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6902024-12-20T21:30:49.595ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6912024-12-20T21:30:49.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
6922024-12-20T21:30:49.595ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6932024-12-20T21:30:49.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6942024-12-20T21:30:49.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6952024-12-20T21:30:49.595ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6962024-12-20T21:30:49.595ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6972024-12-20T21:30:49.596ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6982024-12-20T21:30:49.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6992024-12-20T21:30:49.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 58.698897ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
7002024-12-20T21:30:49.597ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1348, tv_nsec: 877822621 } })
7012024-12-20T21:30:49.598ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
7022024-12-20T21:30:49.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7032024-12-20T21:30:49.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7042024-12-20T21:30:49.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7052024-12-20T21:30:49.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7062024-12-20T21:30:49.600ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.668075ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7072024-12-20T21:30:49.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7082024-12-20T21:30:49.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 62.699426ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7092024-12-20T21:30:49.602ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
7102024-12-20T21:30:49.602ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7112024-12-20T21:30:49.602ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f052c68-6dbe-452b-9513-58f31512c4da", "content-length": "26", "date": "Fri, 20 Dec 2024 21:30:48 GMT"} })
7122024-12-20T21:30:49.602ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7132024-12-20T21:30:49.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
7142024-12-20T21:30:49.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7152024-12-20T21:30:49.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7162024-12-20T21:30:49.603ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
7172024-12-20T21:30:49.603ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7182024-12-20T21:30:49.603ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7dd6caf1-3270-45d1-b339-6c6fbdadec04", "content-length": "26", "date": "Fri, 20 Dec 2024 21:30:48 GMT"} })
7192024-12-20T21:30:49.603ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7202024-12-20T21:30:49.603ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7212024-12-20T21:30:49.603ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7222024-12-20T21:30:49.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7232024-12-20T21:30:49.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
7242024-12-20T21:30:49.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7252024-12-20T21:30:49.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7262024-12-20T21:30:49.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7272024-12-20T21:30:49.604ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7282024-12-20T21:30:49.605ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7292024-12-20T21:30:49.605ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.722286ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7302024-12-20T21:30:49.605ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7312024-12-20T21:30:49.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7322024-12-20T21:30:49.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7332024-12-20T21:30:49.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7342024-12-20T21:30:49.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7352024-12-20T21:30:49.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7362024-12-20T21:30:49.612ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
7372024-12-20T21:30:49.612ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.821516ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
7382024-12-20T21:30:49.625ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7392024-12-20T21:30:49.625ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7402024-12-20T21:30:49.625ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 87.199005ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7412024-12-20T21:30:49.629ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7422024-12-20T21:30:49.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7432024-12-20T21:30:49.631ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7442024-12-20T21:30:49.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7452024-12-20T21:30:49.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7462024-12-20T21:30:49.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c74ff24-982c-40fd-86fd-ef04898c5922, lookup_type: ById(8c74ff24-982c-40fd-86fd-ef04898c5922) } result = Ok(())
7472024-12-20T21:30:49.635ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7482024-12-20T21:30:49.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7492024-12-20T21:30:49.637ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 98.784935ms iteration = 18 status = 0
7502024-12-20T21:30:49.663ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7512024-12-20T21:30:49.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7522024-12-20T21:30:49.668ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac zone_address = fd00:1122:3344:101::2
7532024-12-20T21:30:49.668ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7542024-12-20T21:30:49.669ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d8c085a-065f-4609-908e-2ecbc05964b3", "content-length": "26", "date": "Fri, 20 Dec 2024 21:30:48 GMT"} })
7552024-12-20T21:30:49.669ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7562024-12-20T21:30:49.670ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
7572024-12-20T21:30:49.679ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 141.372821ms iteration = 18 status = {}
7582024-12-20T21:30:49.685ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7592024-12-20T21:30:49.685ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1466bd8-26a3-4d81-862e-e4860ac69058", "content-length": "1", "date": "Fri, 20 Dec 2024 21:30:48 GMT"} })
7602024-12-20T21:30:49.686ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7612024-12-20T21:30:49.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7622024-12-20T21:30:49.694ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 155.689851ms iteration = 20 status = {"physical_disks_added":0}
7632024-12-20T21:30:49.711ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7642024-12-20T21:30:49.711ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7652024-12-20T21:30:49.712ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d222fe06-1d7a-4bbe-9052-0fd5d688e23a", "content-length": "372", "date": "Fri, 20 Dec 2024 21:30:49 GMT"} })
7662024-12-20T21:30:49.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7672024-12-20T21:30:49.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7682024-12-20T21:30:49.713ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7692024-12-20T21:30:49.713ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 175.391893ms iteration = 18 status = null
7702024-12-20T21:30:49.714ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7712024-12-20T21:30:49.714ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7722024-12-20T21:30:49.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7732024-12-20T21:30:49.716ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7742024-12-20T21:30:49.717ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7752024-12-20T21:30:49.717ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7762024-12-20T21:30:49.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7772024-12-20T21:30:49.751ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
7782024-12-20T21:30:49.751ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7792024-12-20T21:30:49.751ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7c633b25-b28c-4adb-8b1a-3b64f978b12b", "date": "Fri, 20 Dec 2024 21:30:49 GMT"} })
7802024-12-20T21:30:49.751ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7812024-12-20T21:30:49.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7822024-12-20T21:30:49.754ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7832024-12-20T21:30:49.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7842024-12-20T21:30:49.756ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7852024-12-20T21:30:49.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7862024-12-20T21:30:49.757ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7872024-12-20T21:30:49.758ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "158eed12-7e93-4fbf-a898-f9db05a820bf", "content-length": "691", "date": "Fri, 20 Dec 2024 21:30:49 GMT"} })
7882024-12-20T21:30:49.758ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
7892024-12-20T21:30:49.758ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
7902024-12-20T21:30:49.758ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
7912024-12-20T21:30:49.758ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 220.022404ms iteration = 18 status = {}
7922024-12-20T21:30:49.760ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7932024-12-20T21:30:49.760ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7942024-12-20T21:30:49.760ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b1e7ce57-32dc-4341-a52f-c3a056c0aade", "date": "Fri, 20 Dec 2024 21:30:49 GMT"} })
7952024-12-20T21:30:49.762ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 223.579873ms iteration = 18 status = {}
7962024-12-20T21:30:49.781ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7972024-12-20T21:30:49.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7982024-12-20T21:30:49.783ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 583388f4-92af-4a10-817c-62f2e9571310, rack_id: a7e68df9-95f5-4fda-aae0-2f46483e29ac, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bacaa666-9eda-4bc8-9ccd-35df228fd476) } rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
7992024-12-20T21:30:49.783ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8002024-12-20T21:30:49.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8012024-12-20T21:30:49.789ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8022024-12-20T21:30:49.789ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "311d1eb6-0204-4ebb-908c-c59bd3fb2e59", "content-length": "134", "date": "Fri, 20 Dec 2024 21:30:48 GMT"} })
8032024-12-20T21:30:49.789ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8042024-12-20T21:30:49.789ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bacaa666-9eda-4bc8-9ccd-35df228fd476
8052024-12-20T21:30:49.790ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8062024-12-20T21:30:49.790ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8072024-12-20T21:30:49.790ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8082024-12-20T21:30:49.790ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8092024-12-20T21:30:49.790ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8102024-12-20T21:30:49.790ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8112024-12-20T21:30:49.790ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8122024-12-20T21:30:49.790ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8132024-12-20T21:30:49.790ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
8142024-12-20T21:30:49.790ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8152024-12-20T21:30:49.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8162024-12-20T21:30:49.792ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8172024-12-20T21:30:49.792ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0818bf4-3669-40b4-a303-01be2c1a2ea0", "content-length": "2", "date": "Fri, 20 Dec 2024 21:30:48 GMT"} })
8182024-12-20T21:30:49.792ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8192024-12-20T21:30:49.792ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a2089d8-bdb9-42c5-b21f-1e340b03b3c7", "content-length": "52", "date": "Fri, 20 Dec 2024 21:30:48 GMT"} })
8202024-12-20T21:30:49.792ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
8212024-12-20T21:30:49.792ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8222024-12-20T21:30:49.887ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b468abb5-60c9-4407-bc9c-a2c18eeff555", "date": "Fri, 20 Dec 2024 21:30:49 GMT"} })
8232024-12-20T21:30:49.887ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch = Switch0
8242024-12-20T21:30:49.887ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8252024-12-20T21:30:49.887ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cec0564e-caa2-44a2-8ee6-1885bd10145b", "content-length": "682", "date": "Fri, 20 Dec 2024 21:30:49 GMT"} })
8262024-12-20T21:30:49.887ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8272024-12-20T21:30:49.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8282024-12-20T21:30:49.891ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8292024-12-20T21:30:49.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8302024-12-20T21:30:49.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8312024-12-20T21:30:49.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8322024-12-20T21:30:49.897ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8332024-12-20T21:30:49.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8342024-12-20T21:30:49.905ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 367.200173ms iteration = 18 status = {}
8352024-12-20T21:30:50.134ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
8362024-12-20T21:30:50.134ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
8372024-12-20T21:30:50.165ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
8382024-12-20T21:30:50.165ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:55919
8392024-12-20T21:30:50.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:55919 req_id = d5637e3e-8dca-4c32-b806-777ee677614e roles = RoleSet { roles: {} } uri = /metrics/producers
8402024-12-20T21:30:50.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:55919 req_id = d5637e3e-8dca-4c32-b806-777ee677614e resource = Database result = Ok(()) uri = /metrics/producers
8412024-12-20T21:30:50.201ZINFOnexus: assigned collector to new producer collector_id = f413b9dc-12d9-42dc-9e49-cb25b63f7e80 file = nexus/src/app/oximeter.rs:76 producer_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
8422024-12-20T21:30:50.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36126 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:55919 req_id = d5637e3e-8dca-4c32-b806-777ee677614e response_code = 201 uri = /metrics/producers
8432024-12-20T21:30:50.201ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "d5637e3e-8dca-4c32-b806-777ee677614e", "content-length": "41", "date": "Fri, 20 Dec 2024 21:30:50 GMT"} })
8442024-12-20T21:30:50.203ZDEBGnexus (producer-registration-task): registered with nexus successfully
8452024-12-20T21:30:50.203ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
8462024-12-20T21:30:50.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cac52ef8-557f-4781-8978-ac3f745ff242 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8472024-12-20T21:30:50.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cac52ef8-557f-4781-8978-ac3f745ff242 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8482024-12-20T21:30:50.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cac52ef8-557f-4781-8978-ac3f745ff242 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8492024-12-20T21:30:50.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = a4bdeb59-c77c-4e58-943d-f82c96e744cd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
8502024-12-20T21:30:50.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = a4bdeb59-c77c-4e58-943d-f82c96e744cd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
8512024-12-20T21:30:50.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = a4bdeb59-c77c-4e58-943d-f82c96e744cd response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
8522024-12-20T21:30:51.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bf22481e-d4a6-42e5-8fc7-4733ac75fbf8 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8532024-12-20T21:30:51.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bf22481e-d4a6-42e5-8fc7-4733ac75fbf8 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8542024-12-20T21:30:51.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bf22481e-d4a6-42e5-8fc7-4733ac75fbf8 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8552024-12-20T21:30:52.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c0cf744d-0f7a-4a2b-810d-551a1d5ac826 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8562024-12-20T21:30:52.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c0cf744d-0f7a-4a2b-810d-551a1d5ac826 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8572024-12-20T21:30:52.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c0cf744d-0f7a-4a2b-810d-551a1d5ac826 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8582024-12-20T21:30:53.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 341a95b8-ea8c-4122-9466-90ddcd4d19bf roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8592024-12-20T21:30:53.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 341a95b8-ea8c-4122-9466-90ddcd4d19bf resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8602024-12-20T21:30:53.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1899 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 341a95b8-ea8c-4122-9466-90ddcd4d19bf response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8612024-12-20T21:30:54.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9f0c9f99-4b75-4362-a824-48980a3d398c roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8622024-12-20T21:30:54.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9f0c9f99-4b75-4362-a824-48980a3d398c resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8632024-12-20T21:30:54.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9f0c9f99-4b75-4362-a824-48980a3d398c response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8642024-12-20T21:30:55.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8f9b1e49-4e77-42da-b4b0-7e07ff55dc06 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8652024-12-20T21:30:55.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8f9b1e49-4e77-42da-b4b0-7e07ff55dc06 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8662024-12-20T21:30:55.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8f9b1e49-4e77-42da-b4b0-7e07ff55dc06 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8672024-12-20T21:30:56.405ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 647 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = efeafcc9-5817-4166-84d2-cfff2ac24669 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
8682024-12-20T21:30:56.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8061f63e-a15e-4c6f-a3e4-78ba38257c10 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8692024-12-20T21:30:56.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8061f63e-a15e-4c6f-a3e4-78ba38257c10 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8702024-12-20T21:30:56.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2609 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8061f63e-a15e-4c6f-a3e4-78ba38257c10 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8712024-12-20T21:30:57.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 95bfa244-4585-4965-bb05-e74b12446b91 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8722024-12-20T21:30:57.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 95bfa244-4585-4965-bb05-e74b12446b91 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8732024-12-20T21:30:57.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2016 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 95bfa244-4585-4965-bb05-e74b12446b91 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8742024-12-20T21:30:58.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 784332ec-6279-4984-bd91-20e73e4bae21 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8752024-12-20T21:30:58.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 784332ec-6279-4984-bd91-20e73e4bae21 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8762024-12-20T21:30:58.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 784332ec-6279-4984-bd91-20e73e4bae21 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8772024-12-20T21:30:59.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0f7e8729-bdac-44c3-b1ce-096590395ea5 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8782024-12-20T21:30:59.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0f7e8729-bdac-44c3-b1ce-096590395ea5 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8792024-12-20T21:30:59.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2559 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0f7e8729-bdac-44c3-b1ce-096590395ea5 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
8802024-12-20T21:30:59.538ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
8812024-12-20T21:30:59.538ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
8822024-12-20T21:30:59.538ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8832024-12-20T21:30:59.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8842024-12-20T21:30:59.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8852024-12-20T21:30:59.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8862024-12-20T21:30:59.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8872024-12-20T21:30:59.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8882024-12-20T21:30:59.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8892024-12-20T21:30:59.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8902024-12-20T21:30:59.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8912024-12-20T21:30:59.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8922024-12-20T21:30:59.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8932024-12-20T21:30:59.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
8942024-12-20T21:30:59.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8952024-12-20T21:30:59.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8962024-12-20T21:30:59.561ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
8972024-12-20T21:30:59.561ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.050987ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
8982024-12-20T21:30:59.571ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8992024-12-20T21:30:59.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9002024-12-20T21:30:59.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.064765ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9012024-12-20T21:31:00.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 813085fa-301d-427a-982c-0d3d6fc9f311 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9022024-12-20T21:31:00.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 813085fa-301d-427a-982c-0d3d6fc9f311 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9032024-12-20T21:31:00.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 813085fa-301d-427a-982c-0d3d6fc9f311 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9042024-12-20T21:31:01.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ff01da65-8886-46bf-b984-8b74ea188767 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9052024-12-20T21:31:01.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ff01da65-8886-46bf-b984-8b74ea188767 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9062024-12-20T21:31:01.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ff01da65-8886-46bf-b984-8b74ea188767 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9072024-12-20T21:31:02.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0d17c047-0795-421b-8daf-640d6626ea86 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9082024-12-20T21:31:02.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0d17c047-0795-421b-8daf-640d6626ea86 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9092024-12-20T21:31:02.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1758 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0d17c047-0795-421b-8daf-640d6626ea86 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9102024-12-20T21:31:03.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 29c6d803-dab0-4de5-950b-12407f319e25 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9112024-12-20T21:31:03.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 29c6d803-dab0-4de5-950b-12407f319e25 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9122024-12-20T21:31:03.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1975 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 29c6d803-dab0-4de5-950b-12407f319e25 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9132024-12-20T21:31:04.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6e047064-ada5-446e-a32a-f384c7ba29be roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9142024-12-20T21:31:04.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6e047064-ada5-446e-a32a-f384c7ba29be resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9152024-12-20T21:31:04.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1945 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6e047064-ada5-446e-a32a-f384c7ba29be response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9162024-12-20T21:31:05.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f932b59e-fe20-47b1-9381-b4eb63625ce3 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9172024-12-20T21:31:05.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f932b59e-fe20-47b1-9381-b4eb63625ce3 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9182024-12-20T21:31:05.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f932b59e-fe20-47b1-9381-b4eb63625ce3 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9192024-12-20T21:31:06.405ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 617 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = eba80933-f48a-4890-85a1-4d51f9b95789 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
9202024-12-20T21:31:06.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 37f80610-df5e-4edf-94f9-4bc9472162e7 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9212024-12-20T21:31:06.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 37f80610-df5e-4edf-94f9-4bc9472162e7 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9222024-12-20T21:31:06.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 37f80610-df5e-4edf-94f9-4bc9472162e7 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9232024-12-20T21:31:07.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fbcebe8c-d1fe-417a-a2e1-de8a9a8924c4 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9242024-12-20T21:31:07.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fbcebe8c-d1fe-417a-a2e1-de8a9a8924c4 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9252024-12-20T21:31:07.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1871 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fbcebe8c-d1fe-417a-a2e1-de8a9a8924c4 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9262024-12-20T21:31:08.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 939ef08e-6e80-4418-9da5-11c97383136f roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9272024-12-20T21:31:08.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 939ef08e-6e80-4418-9da5-11c97383136f resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9282024-12-20T21:31:08.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 939ef08e-6e80-4418-9da5-11c97383136f response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9292024-12-20T21:31:09.538ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
9302024-12-20T21:31:09.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9312024-12-20T21:31:09.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
9322024-12-20T21:31:09.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9332024-12-20T21:31:09.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9342024-12-20T21:31:09.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9352024-12-20T21:31:09.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9362024-12-20T21:31:09.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9372024-12-20T21:31:09.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.512949ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9382024-12-20T21:31:09.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9392024-12-20T21:31:09.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9402024-12-20T21:31:09.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9412024-12-20T21:31:09.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9422024-12-20T21:31:09.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9432024-12-20T21:31:09.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9442024-12-20T21:31:09.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9452024-12-20T21:31:09.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
9462024-12-20T21:31:09.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9472024-12-20T21:31:09.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9482024-12-20T21:31:09.592ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
9492024-12-20T21:31:09.592ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.243924ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
9502024-12-20T21:31:09.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 48b706aa-950c-48aa-a33b-638b5127dd3b roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9512024-12-20T21:31:09.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 48b706aa-950c-48aa-a33b-638b5127dd3b resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9522024-12-20T21:31:09.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1757 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 48b706aa-950c-48aa-a33b-638b5127dd3b response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9532024-12-20T21:31:10.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 15cecf16-a5e8-46a5-8b4f-3cdaf864f994 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9542024-12-20T21:31:10.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 15cecf16-a5e8-46a5-8b4f-3cdaf864f994 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9552024-12-20T21:31:10.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1851 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 15cecf16-a5e8-46a5-8b4f-3cdaf864f994 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9562024-12-20T21:31:11.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4468b847-524b-407a-99fd-d694e51c6982 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9572024-12-20T21:31:11.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4468b847-524b-407a-99fd-d694e51c6982 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9582024-12-20T21:31:11.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4468b847-524b-407a-99fd-d694e51c6982 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9592024-12-20T21:31:12.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a62619c5-0f83-464a-92c5-55595f2b2dd0 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9602024-12-20T21:31:12.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a62619c5-0f83-464a-92c5-55595f2b2dd0 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9612024-12-20T21:31:12.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a62619c5-0f83-464a-92c5-55595f2b2dd0 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9622024-12-20T21:31:13.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 81063578-870a-40e7-845b-807294c71d72 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9632024-12-20T21:31:13.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 81063578-870a-40e7-845b-807294c71d72 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9642024-12-20T21:31:13.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 81063578-870a-40e7-845b-807294c71d72 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9652024-12-20T21:31:14.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ebe69339-0b51-43e2-a584-7ba005381014 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9662024-12-20T21:31:14.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ebe69339-0b51-43e2-a584-7ba005381014 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9672024-12-20T21:31:14.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ebe69339-0b51-43e2-a584-7ba005381014 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9682024-12-20T21:31:15.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5ce1bd8e-d192-4bdd-b2f9-7f43e96d73a2 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9692024-12-20T21:31:15.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5ce1bd8e-d192-4bdd-b2f9-7f43e96d73a2 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9702024-12-20T21:31:15.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5ce1bd8e-d192-4bdd-b2f9-7f43e96d73a2 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9712024-12-20T21:31:16.405ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 523 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 7a532dae-234d-407a-8daf-2849cfd92a44 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
9722024-12-20T21:31:16.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9019deb1-cf5e-4711-ad3e-2e0475193219 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9732024-12-20T21:31:16.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9019deb1-cf5e-4711-ad3e-2e0475193219 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9742024-12-20T21:31:16.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9019deb1-cf5e-4711-ad3e-2e0475193219 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9752024-12-20T21:31:17.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f23bdff6-af3d-4cb0-9884-9762aa65b24c roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9762024-12-20T21:31:17.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f23bdff6-af3d-4cb0-9884-9762aa65b24c resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9772024-12-20T21:31:17.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f23bdff6-af3d-4cb0-9884-9762aa65b24c response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9782024-12-20T21:31:18.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 927be877-348e-4f12-be9a-9e5bdda45f87 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9792024-12-20T21:31:18.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 927be877-348e-4f12-be9a-9e5bdda45f87 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9802024-12-20T21:31:18.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 927be877-348e-4f12-be9a-9e5bdda45f87 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
9812024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
9822024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
9832024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9842024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9852024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
9862024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
9872024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9882024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
9892024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
9902024-12-20T21:31:19.538ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
9912024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
9922024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
9932024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
9942024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
9952024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
9962024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
9972024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9982024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9992024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
10002024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
10012024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10022024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
10032024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
10042024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10052024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
10062024-12-20T21:31:19.538ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10072024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10082024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
10092024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
10102024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
10112024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10122024-12-20T21:31:19.538ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 21:21:19.538733020 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
10132024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10142024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
10152024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
10162024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10172024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
10182024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
10192024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
10202024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
10212024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10222024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
10232024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10242024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10252024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
10262024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10272024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
10282024-12-20T21:31:19.538ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9112287e-7109-46ca-aa8a-610048d83c82
10292024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
10302024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.15\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"9112287e-7109-46ca-aa8a-610048d83c82"}
10312024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10322024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
10332024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
10342024-12-20T21:31:19.538ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
10352024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10362024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
10372024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
10382024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10392024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
10402024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
10412024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
10422024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10432024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
10442024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10452024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10462024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10472024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10482024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
10492024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10502024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10512024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10522024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10532024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10542024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10552024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10562024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10572024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
10582024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10592024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
10602024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10612024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
10622024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10632024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10642024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10652024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
10662024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10672024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10682024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10692024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10702024-12-20T21:31:19.539ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4565f09e-ee63-469d-bb6e-3ccd4abd01fe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("73abfaca-4f35-4f97-9980-1890d6dba8fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3f6b067-d10e-44b3-9f21-f8e5a96a2b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3f6b067-d10e-44b3-9f21-f8e5a96a2b37.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1378, tv_nsec: 819266368 } })
10712024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
10722024-12-20T21:31:19.539ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("065cea45-0eca-4287-90a0-2c3c20ec32f8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b24cb173-c3a3-4237-abe6-0e7953a415e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b24cb173-c3a3-4237-abe6-0e7953a415e5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1378, tv_nsec: 819363480 } })
10732024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10742024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10752024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10762024-12-20T21:31:19.539ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10772024-12-20T21:31:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10782024-12-20T21:31:19.540ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10792024-12-20T21:31:19.540ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
10802024-12-20T21:31:19.540ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.355441ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
10812024-12-20T21:31:19.540ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
10822024-12-20T21:31:19.540ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.526554ms iteration = 10 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
10832024-12-20T21:31:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10842024-12-20T21:31:19.541ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10852024-12-20T21:31:19.541ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10862024-12-20T21:31:19.541ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1378, tv_nsec: 821593990 } })
10872024-12-20T21:31:19.542ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
10882024-12-20T21:31:19.542ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10892024-12-20T21:31:19.542ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.900718ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10902024-12-20T21:31:19.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10912024-12-20T21:31:19.543ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
10922024-12-20T21:31:19.544ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10932024-12-20T21:31:19.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10942024-12-20T21:31:19.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
10952024-12-20T21:31:19.544ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
10962024-12-20T21:31:19.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
10972024-12-20T21:31:19.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
10982024-12-20T21:31:19.545ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10992024-12-20T21:31:19.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11002024-12-20T21:31:19.546ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1378, tv_nsec: 825949098 } })
11012024-12-20T21:31:19.546ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
11022024-12-20T21:31:19.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11032024-12-20T21:31:19.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11042024-12-20T21:31:19.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11052024-12-20T21:31:19.549ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11062024-12-20T21:31:19.550ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11072024-12-20T21:31:19.550ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.443487ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
11082024-12-20T21:31:19.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11092024-12-20T21:31:19.552ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11102024-12-20T21:31:19.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11112024-12-20T21:31:19.552ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11122024-12-20T21:31:19.552ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11132024-12-20T21:31:19.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11142024-12-20T21:31:19.554ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11152024-12-20T21:31:19.554ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 21:21:19.538733020 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
11162024-12-20T21:31:19.554ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 16.172313ms iteration = 10 status = {"expiration":"2024-12-20T21:21:19.538733020Z","pruned":[]}
11172024-12-20T21:31:19.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11182024-12-20T21:31:19.557ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11192024-12-20T21:31:19.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11202024-12-20T21:31:19.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11212024-12-20T21:31:19.560ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11222024-12-20T21:31:19.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11232024-12-20T21:31:19.561ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11242024-12-20T21:31:19.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11252024-12-20T21:31:19.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11262024-12-20T21:31:19.562ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11272024-12-20T21:31:19.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11282024-12-20T21:31:19.564ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11292024-12-20T21:31:19.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11302024-12-20T21:31:19.567ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11312024-12-20T21:31:19.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11322024-12-20T21:31:19.567ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11332024-12-20T21:31:19.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11342024-12-20T21:31:19.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11352024-12-20T21:31:19.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11362024-12-20T21:31:19.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11372024-12-20T21:31:19.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11382024-12-20T21:31:19.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11392024-12-20T21:31:19.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11402024-12-20T21:31:19.585ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11412024-12-20T21:31:19.585ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11422024-12-20T21:31:19.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11432024-12-20T21:31:19.586ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11442024-12-20T21:31:19.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11452024-12-20T21:31:19.588ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.660473ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
11462024-12-20T21:31:19.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11472024-12-20T21:31:19.589ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11482024-12-20T21:31:19.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11492024-12-20T21:31:19.590ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11502024-12-20T21:31:19.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11512024-12-20T21:31:19.592ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11522024-12-20T21:31:19.592ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11532024-12-20T21:31:19.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11542024-12-20T21:31:19.593ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11552024-12-20T21:31:19.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11562024-12-20T21:31:19.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
11572024-12-20T21:31:19.595ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11582024-12-20T21:31:19.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11592024-12-20T21:31:19.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
11602024-12-20T21:31:19.595ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11612024-12-20T21:31:19.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11622024-12-20T21:31:19.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
11632024-12-20T21:31:19.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11642024-12-20T21:31:19.596ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.999211ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
11652024-12-20T21:31:19.596ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11662024-12-20T21:31:19.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11672024-12-20T21:31:19.597ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11682024-12-20T21:31:19.597ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11692024-12-20T21:31:19.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11702024-12-20T21:31:19.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11712024-12-20T21:31:19.598ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.580686ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11722024-12-20T21:31:19.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11732024-12-20T21:31:19.600ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11742024-12-20T21:31:19.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11752024-12-20T21:31:19.600ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
11762024-12-20T21:31:19.600ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1378, tv_nsec: 880704466 } })
11772024-12-20T21:31:19.601ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
11782024-12-20T21:31:19.601ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 62.42266ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
11792024-12-20T21:31:19.601ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
11802024-12-20T21:31:19.608ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11812024-12-20T21:31:19.609ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
11822024-12-20T21:31:19.609ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
11832024-12-20T21:31:19.609ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 70.124452ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
11842024-12-20T21:31:19.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11852024-12-20T21:31:19.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11862024-12-20T21:31:19.612ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11872024-12-20T21:31:19.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11882024-12-20T21:31:19.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11892024-12-20T21:31:19.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11902024-12-20T21:31:19.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11912024-12-20T21:31:19.615ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 76.69302ms iteration = 5 status = {"nsuccess":5}
11922024-12-20T21:31:19.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11932024-12-20T21:31:19.616ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11942024-12-20T21:31:19.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11952024-12-20T21:31:19.618ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
11962024-12-20T21:31:19.618ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 80.26974ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
11972024-12-20T21:31:19.619ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11982024-12-20T21:31:19.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11992024-12-20T21:31:19.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12002024-12-20T21:31:19.625ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
12012024-12-20T21:31:19.625ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 86.286585ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
12022024-12-20T21:31:19.625ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
12032024-12-20T21:31:19.625ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
12042024-12-20T21:31:19.625ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
12052024-12-20T21:31:19.625ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12062024-12-20T21:31:19.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12072024-12-20T21:31:19.630ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
12082024-12-20T21:31:19.630ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
12092024-12-20T21:31:19.630ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
12102024-12-20T21:31:19.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12112024-12-20T21:31:19.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12122024-12-20T21:31:19.631ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12132024-12-20T21:31:19.634ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12142024-12-20T21:31:19.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12152024-12-20T21:31:19.636ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12162024-12-20T21:31:19.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 97.759272ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
12172024-12-20T21:31:19.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12182024-12-20T21:31:19.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12192024-12-20T21:31:19.637ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12202024-12-20T21:31:19.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12212024-12-20T21:31:19.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 101.25536ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12222024-12-20T21:31:19.641ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12232024-12-20T21:31:19.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12242024-12-20T21:31:19.643ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12252024-12-20T21:31:19.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12262024-12-20T21:31:19.646ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
12272024-12-20T21:31:19.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
12282024-12-20T21:31:19.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12292024-12-20T21:31:19.652ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12302024-12-20T21:31:19.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12312024-12-20T21:31:19.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12322024-12-20T21:31:19.654ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12332024-12-20T21:31:19.654ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
12342024-12-20T21:31:19.654ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12352024-12-20T21:31:19.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12362024-12-20T21:31:19.654ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 115.384347ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12372024-12-20T21:31:19.657ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12382024-12-20T21:31:19.660ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12392024-12-20T21:31:19.660ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12402024-12-20T21:31:19.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12412024-12-20T21:31:19.660ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12422024-12-20T21:31:19.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12432024-12-20T21:31:19.661ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12442024-12-20T21:31:19.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c74ff24-982c-40fd-86fd-ef04898c5922, lookup_type: ById(8c74ff24-982c-40fd-86fd-ef04898c5922) } result = Ok(())
12452024-12-20T21:31:19.664ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12462024-12-20T21:31:19.664ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
12472024-12-20T21:31:19.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12482024-12-20T21:31:19.665ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
12492024-12-20T21:31:19.665ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12502024-12-20T21:31:19.665ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac5191f1-95f3-40a3-9249-abb6dc98e4cb", "content-length": "26", "date": "Fri, 20 Dec 2024 21:31:18 GMT"} })
12512024-12-20T21:31:19.665ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12522024-12-20T21:31:19.666ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 127.435628ms iteration = 19 status = 0
12532024-12-20T21:31:19.667ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12542024-12-20T21:31:19.678ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
12552024-12-20T21:31:19.678ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4aec9cd8-ad86-40dc-bdd7-2394e3237b38 dns_zone_name = oxide.test found_so_far = 0 version = 2
12562024-12-20T21:31:19.678ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12572024-12-20T21:31:19.678ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
12582024-12-20T21:31:19.678ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c58feff7-51f2-445e-83fd-a0c3a102f4ed dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
12592024-12-20T21:31:19.678ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12602024-12-20T21:31:19.678ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12612024-12-20T21:31:19.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12622024-12-20T21:31:19.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12632024-12-20T21:31:19.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12642024-12-20T21:31:19.679ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
12652024-12-20T21:31:19.680ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12662024-12-20T21:31:19.680ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12672024-12-20T21:31:19.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12682024-12-20T21:31:19.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12692024-12-20T21:31:19.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12702024-12-20T21:31:19.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12712024-12-20T21:31:19.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12722024-12-20T21:31:19.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12732024-12-20T21:31:19.686ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
12742024-12-20T21:31:19.686ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12752024-12-20T21:31:19.686ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d6358b3-cc5f-4f41-9735-27de20679c16", "content-length": "26", "date": "Fri, 20 Dec 2024 21:31:18 GMT"} })
12762024-12-20T21:31:19.686ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12772024-12-20T21:31:19.686ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c58feff7-51f2-445e-83fd-a0c3a102f4ed dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
12782024-12-20T21:31:19.686ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
12792024-12-20T21:31:19.686ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 21:23:04.517297 UTC dns_group = internal generation = 1
12802024-12-20T21:31:19.686ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 147.685281ms iteration = 10 status = {"generation":1}
12812024-12-20T21:31:19.686ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4aec9cd8-ad86-40dc-bdd7-2394e3237b38 dns_zone_name = oxide.test found_so_far = 1 version = 2
12822024-12-20T21:31:19.686ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
12832024-12-20T21:31:19.686ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 21:23:05.526309 UTC dns_group = external generation = 2
12842024-12-20T21:31:19.686ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 148.03466ms iteration = 10 status = {"generation":2}
12852024-12-20T21:31:19.689ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12862024-12-20T21:31:19.689ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12872024-12-20T21:31:19.689ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
12882024-12-20T21:31:19.689ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 150.668609ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
12892024-12-20T21:31:19.701ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T21:22:10.640928Z, time_modified: 2024-12-20T21:22:10.640928Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, db_silo: Silo { identity: SiloIdentity { id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T21:23:05.471312Z, time_modified: 2024-12-20T21:23:05.471312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, db_silo: Silo { identity: SiloIdentity { id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T21:23:05.471312Z, time_modified: 2024-12-20T21:23:05.471312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b" }] }) }
12902024-12-20T21:31:19.701ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 163.373973ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"66e8bce1-b95a-4433-886f-e35fda6d9a14","tls_certs":["4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b"]}},"default_endpoint":{"silo_id":"66e8bce1-b95a-4433-886f-e35fda6d9a14","tls_certs":["4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
12912024-12-20T21:31:19.740ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 201.351375ms iteration = 21 status = {"physical_disks_added":0}
12922024-12-20T21:31:19.740ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
12932024-12-20T21:31:19.740ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 201.895617ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
12942024-12-20T21:31:19.765ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac zone_address = fd00:1122:3344:101::2
12952024-12-20T21:31:19.765ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12962024-12-20T21:31:19.766ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2f29dcd-ebc6-4f4b-b5e8-b01fde078cef", "content-length": "26", "date": "Fri, 20 Dec 2024 21:31:18 GMT"} })
12972024-12-20T21:31:19.766ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12982024-12-20T21:31:19.767ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
12992024-12-20T21:31:19.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13002024-12-20T21:31:19.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13012024-12-20T21:31:19.812ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
13022024-12-20T21:31:19.812ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "db0a390c-13db-456f-8e1e-fd64c134ed28", "date": "Fri, 20 Dec 2024 21:31:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13032024-12-20T21:31:19.812ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13042024-12-20T21:31:19.815ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ee5265ca-0678-4ab1-8f6c-83872d88df5e", "date": "Fri, 20 Dec 2024 21:31:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13052024-12-20T21:31:19.815ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13062024-12-20T21:31:19.817ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13072024-12-20T21:31:19.817ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 278.589927ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
13082024-12-20T21:31:19.838ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 299.6996ms iteration = 19 status = {}
13092024-12-20T21:31:19.839ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
13102024-12-20T21:31:19.839ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13112024-12-20T21:31:19.839ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "40341282-0428-4a12-a853-849710519bcc", "content-length": "372", "date": "Fri, 20 Dec 2024 21:31:19 GMT"} })
13122024-12-20T21:31:19.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13132024-12-20T21:31:19.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13142024-12-20T21:31:19.841ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13152024-12-20T21:31:19.842ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13162024-12-20T21:31:19.842ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13172024-12-20T21:31:19.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13182024-12-20T21:31:19.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13192024-12-20T21:31:19.845ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
13202024-12-20T21:31:19.846ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13212024-12-20T21:31:19.846ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13222024-12-20T21:31:19.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13232024-12-20T21:31:19.862ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
13242024-12-20T21:31:19.862ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f46898b-2fe3-424b-b319-403640b978a3", "content-length": "1", "date": "Fri, 20 Dec 2024 21:31:19 GMT"} })
13252024-12-20T21:31:19.864ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13262024-12-20T21:31:19.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13272024-12-20T21:31:19.866ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 328.20534ms iteration = 19 status = null
13282024-12-20T21:31:19.880ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
13292024-12-20T21:31:19.880ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
13302024-12-20T21:31:19.880ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9a3e67b2-d36a-43d2-b68a-b8fc581f61a5", "date": "Fri, 20 Dec 2024 21:31:19 GMT"} })
13312024-12-20T21:31:19.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13322024-12-20T21:31:19.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13332024-12-20T21:31:19.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13342024-12-20T21:31:19.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13352024-12-20T21:31:19.890ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13362024-12-20T21:31:19.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13372024-12-20T21:31:19.894ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
13382024-12-20T21:31:19.894ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13392024-12-20T21:31:19.894ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4ed01c8c-3091-437b-a437-c47c0fa48f66", "date": "Fri, 20 Dec 2024 21:31:19 GMT"} })
13402024-12-20T21:31:19.896ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 357.843354ms iteration = 19 status = {}
13412024-12-20T21:31:19.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1992c36e-e098-42d5-bbbd-be716e33a758 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
13422024-12-20T21:31:19.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1992c36e-e098-42d5-bbbd-be716e33a758 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
13432024-12-20T21:31:19.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2708 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1992c36e-e098-42d5-bbbd-be716e33a758 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
13442024-12-20T21:31:19.935ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
13452024-12-20T21:31:19.936ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "456a2b48-70e0-4436-867a-580dc3808b4e", "date": "Fri, 20 Dec 2024 21:31:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
13462024-12-20T21:31:19.936ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
13472024-12-20T21:31:19.939ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ed997b3b-a7eb-4444-8763-4cb6a77835e7", "date": "Fri, 20 Dec 2024 21:31:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
13482024-12-20T21:31:19.939ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
13492024-12-20T21:31:19.942ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f8b375b3-2e33-494f-8b6a-56e7a4ce8480", "date": "Fri, 20 Dec 2024 21:31:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
13502024-12-20T21:31:19.942ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
13512024-12-20T21:31:19.944ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
13522024-12-20T21:31:19.944ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 406.240758ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
13532024-12-20T21:31:19.996ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
13542024-12-20T21:31:19.996ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f430adf-2303-47df-b109-bc9522ff0dfa", "content-length": "691", "date": "Fri, 20 Dec 2024 21:31:19 GMT"} })
13552024-12-20T21:31:19.996ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
13562024-12-20T21:31:19.996ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
13572024-12-20T21:31:19.996ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
13582024-12-20T21:31:19.998ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 459.460942ms iteration = 19 status = {}
13592024-12-20T21:31:20.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13602024-12-20T21:31:20.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13612024-12-20T21:31:20.008ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 583388f4-92af-4a10-817c-62f2e9571310, rack_id: a7e68df9-95f5-4fda-aae0-2f46483e29ac, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bacaa666-9eda-4bc8-9ccd-35df228fd476) } rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
13622024-12-20T21:31:20.008ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13632024-12-20T21:31:20.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13642024-12-20T21:31:20.019ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
13652024-12-20T21:31:20.020ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b63e742d-f1c0-4732-9a5c-45747db96163", "content-length": "134", "date": "Fri, 20 Dec 2024 21:31:19 GMT"} })
13662024-12-20T21:31:20.020ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
13672024-12-20T21:31:20.020ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bacaa666-9eda-4bc8-9ccd-35df228fd476
13682024-12-20T21:31:20.020ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
13692024-12-20T21:31:20.020ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
13702024-12-20T21:31:20.020ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13712024-12-20T21:31:20.020ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13722024-12-20T21:31:20.020ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13732024-12-20T21:31:20.020ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13742024-12-20T21:31:20.020ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13752024-12-20T21:31:20.020ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13762024-12-20T21:31:20.020ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
13772024-12-20T21:31:20.020ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13782024-12-20T21:31:20.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13792024-12-20T21:31:20.023ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
13802024-12-20T21:31:20.023ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "075fe3bd-11ad-461f-b4c7-5d0eb103656b", "content-length": "2", "date": "Fri, 20 Dec 2024 21:31:19 GMT"} })
13812024-12-20T21:31:20.023ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
13822024-12-20T21:31:20.023ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6a31345-e4f2-4172-8e2d-274a4de8ecc3", "content-length": "52", "date": "Fri, 20 Dec 2024 21:31:19 GMT"} })
13832024-12-20T21:31:20.023ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
13842024-12-20T21:31:20.023ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
13852024-12-20T21:31:20.116ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d1814e5c-0bc6-4370-9b24-963a664d4811", "date": "Fri, 20 Dec 2024 21:31:19 GMT"} })
13862024-12-20T21:31:20.116ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch = Switch0
13872024-12-20T21:31:20.116ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
13882024-12-20T21:31:20.116ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b9a4be5-9f12-44f3-b9bf-266b05091ca5", "content-length": "682", "date": "Fri, 20 Dec 2024 21:31:19 GMT"} })
13892024-12-20T21:31:20.116ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13902024-12-20T21:31:20.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13912024-12-20T21:31:20.120ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13922024-12-20T21:31:20.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13932024-12-20T21:31:20.125ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13942024-12-20T21:31:20.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13952024-12-20T21:31:20.127ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13962024-12-20T21:31:20.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13972024-12-20T21:31:20.135ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 597.076498ms iteration = 19 status = {}
13982024-12-20T21:31:20.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 00784410-a95c-446b-9bb7-26b276eb2769 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
13992024-12-20T21:31:20.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 00784410-a95c-446b-9bb7-26b276eb2769 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
14002024-12-20T21:31:20.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2875 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 00784410-a95c-446b-9bb7-26b276eb2769 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
14012024-12-20T21:31:20.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 93114011-c36d-45e1-af40-1d6a95a3d8a4 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14022024-12-20T21:31:20.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 93114011-c36d-45e1-af40-1d6a95a3d8a4 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14032024-12-20T21:31:20.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2520 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 93114011-c36d-45e1-af40-1d6a95a3d8a4 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14042024-12-20T21:31:21.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 70d42ac7-b6f1-456e-a86e-b14597e4abc0 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14052024-12-20T21:31:21.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 70d42ac7-b6f1-456e-a86e-b14597e4abc0 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14062024-12-20T21:31:21.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 70d42ac7-b6f1-456e-a86e-b14597e4abc0 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14072024-12-20T21:31:22.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 76089d4f-73be-4bf2-aa90-b45ec2a59b33 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14082024-12-20T21:31:22.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 76089d4f-73be-4bf2-aa90-b45ec2a59b33 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14092024-12-20T21:31:23.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2765 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 76089d4f-73be-4bf2-aa90-b45ec2a59b33 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14102024-12-20T21:31:24.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 464fd64d-f90c-4d01-b122-bdcbf947d9fe roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14112024-12-20T21:31:24.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 464fd64d-f90c-4d01-b122-bdcbf947d9fe resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14122024-12-20T21:31:24.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 464fd64d-f90c-4d01-b122-bdcbf947d9fe response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14132024-12-20T21:31:25.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 57333667-b525-42ab-89ba-0e003a8eabd9 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14142024-12-20T21:31:25.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 57333667-b525-42ab-89ba-0e003a8eabd9 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14152024-12-20T21:31:25.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1932 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 57333667-b525-42ab-89ba-0e003a8eabd9 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14162024-12-20T21:31:26.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c50d0594-e280-45ab-8668-9ecaf7b89d78 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14172024-12-20T21:31:26.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c50d0594-e280-45ab-8668-9ecaf7b89d78 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14182024-12-20T21:31:26.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2418 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c50d0594-e280-45ab-8668-9ecaf7b89d78 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14192024-12-20T21:31:26.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = a48301ad-0d4c-42c6-948c-ec9c62e67a22 roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
14202024-12-20T21:31:26.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = a48301ad-0d4c-42c6-948c-ec9c62e67a22 resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
14212024-12-20T21:31:26.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3107 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = a48301ad-0d4c-42c6-948c-ec9c62e67a22 response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
14222024-12-20T21:31:26.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = beb1e2ac-7bfc-45d4-996b-b66dccb2aa7b roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
14232024-12-20T21:31:26.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = beb1e2ac-7bfc-45d4-996b-b66dccb2aa7b resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
14242024-12-20T21:31:26.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = beb1e2ac-7bfc-45d4-996b-b66dccb2aa7b response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
14252024-12-20T21:31:26.405ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 507 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 31a91adf-c130-41eb-a7d1-c72ee4100087 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
14262024-12-20T21:31:27.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f0afeb2e-0fc5-42b6-8194-8fda2dc583e4 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14272024-12-20T21:31:27.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f0afeb2e-0fc5-42b6-8194-8fda2dc583e4 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14282024-12-20T21:31:27.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f0afeb2e-0fc5-42b6-8194-8fda2dc583e4 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14292024-12-20T21:31:28.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6a7d4c47-c37c-4c64-9133-47b780702a5e roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14302024-12-20T21:31:28.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6a7d4c47-c37c-4c64-9133-47b780702a5e resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14312024-12-20T21:31:28.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6a7d4c47-c37c-4c64-9133-47b780702a5e response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14322024-12-20T21:31:29.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cbfd18e5-451f-42c1-a338-b90d7cc7d944 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14332024-12-20T21:31:29.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cbfd18e5-451f-42c1-a338-b90d7cc7d944 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14342024-12-20T21:31:29.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cbfd18e5-451f-42c1-a338-b90d7cc7d944 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14352024-12-20T21:31:29.538ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
14362024-12-20T21:31:29.538ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
14372024-12-20T21:31:29.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14382024-12-20T21:31:29.538ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14392024-12-20T21:31:29.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14402024-12-20T21:31:29.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14412024-12-20T21:31:29.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14422024-12-20T21:31:29.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14432024-12-20T21:31:29.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14442024-12-20T21:31:29.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14452024-12-20T21:31:29.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14462024-12-20T21:31:29.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14472024-12-20T21:31:29.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14482024-12-20T21:31:29.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
14492024-12-20T21:31:29.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14502024-12-20T21:31:29.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14512024-12-20T21:31:29.563ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
14522024-12-20T21:31:29.563ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.691254ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
14532024-12-20T21:31:29.568ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14542024-12-20T21:31:29.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14552024-12-20T21:31:29.570ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.708661ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14562024-12-20T21:31:30.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0413a6da-2723-4948-82ee-c23c2e5e931e roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14572024-12-20T21:31:30.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0413a6da-2723-4948-82ee-c23c2e5e931e resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14582024-12-20T21:31:30.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0413a6da-2723-4948-82ee-c23c2e5e931e response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14592024-12-20T21:31:31.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 46de1e8c-bd51-493a-b2b5-c4727cdfb23b roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14602024-12-20T21:31:31.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 46de1e8c-bd51-493a-b2b5-c4727cdfb23b resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14612024-12-20T21:31:31.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 46de1e8c-bd51-493a-b2b5-c4727cdfb23b response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14622024-12-20T21:31:32.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = dd8d7f0e-4730-4a64-84c5-cde63f44db70 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14632024-12-20T21:31:32.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = dd8d7f0e-4730-4a64-84c5-cde63f44db70 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14642024-12-20T21:31:32.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1884 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = dd8d7f0e-4730-4a64-84c5-cde63f44db70 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14652024-12-20T21:31:33.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 60fd043e-ae34-49fe-9ec4-a6b05eebde94 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14662024-12-20T21:31:33.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 60fd043e-ae34-49fe-9ec4-a6b05eebde94 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14672024-12-20T21:31:33.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 60fd043e-ae34-49fe-9ec4-a6b05eebde94 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14682024-12-20T21:31:34.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a16f5da8-7ae0-4f2b-9419-02c0671d56bb roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14692024-12-20T21:31:34.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a16f5da8-7ae0-4f2b-9419-02c0671d56bb resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14702024-12-20T21:31:34.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1843 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a16f5da8-7ae0-4f2b-9419-02c0671d56bb response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14712024-12-20T21:31:35.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 581887ac-3489-4bdc-8867-5d9b91ea9be4 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14722024-12-20T21:31:35.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 581887ac-3489-4bdc-8867-5d9b91ea9be4 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14732024-12-20T21:31:35.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 581887ac-3489-4bdc-8867-5d9b91ea9be4 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14742024-12-20T21:31:36.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b4c76fea-4cc6-48a1-9df2-4ca22d7c771b roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14752024-12-20T21:31:36.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b4c76fea-4cc6-48a1-9df2-4ca22d7c771b resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14762024-12-20T21:31:36.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b4c76fea-4cc6-48a1-9df2-4ca22d7c771b response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14772024-12-20T21:31:36.405ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 560 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = ce4eca23-f63e-4c99-b375-8a35455d45c5 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
14782024-12-20T21:31:37.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = eba86cff-983c-4b03-8359-53476ac02412 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14792024-12-20T21:31:37.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = eba86cff-983c-4b03-8359-53476ac02412 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14802024-12-20T21:31:37.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = eba86cff-983c-4b03-8359-53476ac02412 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14812024-12-20T21:31:38.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 883867d6-9aa9-455a-9352-d4c2302caeed roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14822024-12-20T21:31:38.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 883867d6-9aa9-455a-9352-d4c2302caeed resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14832024-12-20T21:31:38.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 883867d6-9aa9-455a-9352-d4c2302caeed response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14842024-12-20T21:31:39.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 875817a1-0491-42f1-ae84-bc9542897291 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14852024-12-20T21:31:39.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 875817a1-0491-42f1-ae84-bc9542897291 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14862024-12-20T21:31:39.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 875817a1-0491-42f1-ae84-bc9542897291 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
14872024-12-20T21:31:39.538ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
14882024-12-20T21:31:39.538ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
14892024-12-20T21:31:39.538ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14902024-12-20T21:31:39.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14912024-12-20T21:31:39.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14922024-12-20T21:31:39.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14932024-12-20T21:31:39.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14942024-12-20T21:31:39.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14952024-12-20T21:31:39.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14962024-12-20T21:31:39.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14972024-12-20T21:31:39.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14982024-12-20T21:31:39.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14992024-12-20T21:31:39.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15002024-12-20T21:31:39.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
15012024-12-20T21:31:39.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15022024-12-20T21:31:39.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15032024-12-20T21:31:39.560ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
15042024-12-20T21:31:39.560ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.274149ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
15052024-12-20T21:31:39.568ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15062024-12-20T21:31:39.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15072024-12-20T21:31:39.569ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.346883ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15082024-12-20T21:31:40.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a1db7862-60f2-4e5b-89ee-91f287254ba8 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15092024-12-20T21:31:40.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a1db7862-60f2-4e5b-89ee-91f287254ba8 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15102024-12-20T21:31:40.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a1db7862-60f2-4e5b-89ee-91f287254ba8 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15112024-12-20T21:31:41.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 378aebb9-6b36-4a7a-8f3b-e4b8e8a75976 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15122024-12-20T21:31:41.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 378aebb9-6b36-4a7a-8f3b-e4b8e8a75976 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15132024-12-20T21:31:41.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 378aebb9-6b36-4a7a-8f3b-e4b8e8a75976 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15142024-12-20T21:31:42.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 86ee1b9e-9982-4550-a43b-4b35e02aff56 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15152024-12-20T21:31:42.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 86ee1b9e-9982-4550-a43b-4b35e02aff56 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15162024-12-20T21:31:42.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 86ee1b9e-9982-4550-a43b-4b35e02aff56 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15172024-12-20T21:31:43.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b9710e8e-98b8-436d-9001-8c349f76402f roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15182024-12-20T21:31:43.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b9710e8e-98b8-436d-9001-8c349f76402f resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15192024-12-20T21:31:43.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b9710e8e-98b8-436d-9001-8c349f76402f response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15202024-12-20T21:31:44.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 470f453f-9799-4433-9d2b-2cede592bc04 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15212024-12-20T21:31:44.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 470f453f-9799-4433-9d2b-2cede592bc04 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15222024-12-20T21:31:44.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 470f453f-9799-4433-9d2b-2cede592bc04 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15232024-12-20T21:31:45.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = acb965eb-d660-4c87-8686-c25f20b38d7f roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15242024-12-20T21:31:45.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = acb965eb-d660-4c87-8686-c25f20b38d7f resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15252024-12-20T21:31:45.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1829 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = acb965eb-d660-4c87-8686-c25f20b38d7f response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15262024-12-20T21:31:46.406ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 685 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = ad75c8e0-e358-4c44-8fa5-8b50573afca1 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
15272024-12-20T21:31:46.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3b7d3649-3aab-486d-a9ba-063bb410a6af roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15282024-12-20T21:31:46.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3b7d3649-3aab-486d-a9ba-063bb410a6af resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15292024-12-20T21:31:46.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1815 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3b7d3649-3aab-486d-a9ba-063bb410a6af response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15302024-12-20T21:31:47.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e06e5fea-4cb7-4464-b267-04b1ee691c19 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15312024-12-20T21:31:47.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e06e5fea-4cb7-4464-b267-04b1ee691c19 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15322024-12-20T21:31:47.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e06e5fea-4cb7-4464-b267-04b1ee691c19 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15332024-12-20T21:31:48.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 16eb2927-0c44-4cd9-a2e1-81a5a36ec787 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15342024-12-20T21:31:48.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 16eb2927-0c44-4cd9-a2e1-81a5a36ec787 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15352024-12-20T21:31:48.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2548 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 16eb2927-0c44-4cd9-a2e1-81a5a36ec787 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
15362024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
15372024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15382024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
15392024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15402024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
15412024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
15422024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
15432024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15442024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
15452024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
15462024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
15472024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
15482024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
15492024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15502024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15512024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
15522024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15532024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
15542024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15552024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15562024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
15572024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15582024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
15592024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
15602024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15612024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
15622024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
15632024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15642024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
15652024-12-20T21:31:49.539ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
15662024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15672024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
15682024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15692024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
15702024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
15712024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15722024-12-20T21:31:49.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15732024-12-20T21:31:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15742024-12-20T21:31:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15752024-12-20T21:31:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15762024-12-20T21:31:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15772024-12-20T21:31:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15782024-12-20T21:31:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15792024-12-20T21:31:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
15802024-12-20T21:31:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15812024-12-20T21:31:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15822024-12-20T21:31:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15832024-12-20T21:31:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15842024-12-20T21:31:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
15852024-12-20T21:31:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15862024-12-20T21:31:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
15872024-12-20T21:31:49.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15882024-12-20T21:31:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15892024-12-20T21:31:49.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15902024-12-20T21:31:49.543ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.781425ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15912024-12-20T21:31:49.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15922024-12-20T21:31:49.545ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15932024-12-20T21:31:49.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15942024-12-20T21:31:49.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15952024-12-20T21:31:49.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15962024-12-20T21:31:49.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15972024-12-20T21:31:49.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15982024-12-20T21:31:49.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15992024-12-20T21:31:49.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16002024-12-20T21:31:49.547ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16012024-12-20T21:31:49.548ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1408, tv_nsec: 828541094 } })
16022024-12-20T21:31:49.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16032024-12-20T21:31:49.549ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
16042024-12-20T21:31:49.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16052024-12-20T21:31:49.549ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16062024-12-20T21:31:49.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16072024-12-20T21:31:49.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
16082024-12-20T21:31:49.551ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16092024-12-20T21:31:49.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16102024-12-20T21:31:49.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16112024-12-20T21:31:49.552ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16122024-12-20T21:31:49.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16132024-12-20T21:31:49.554ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16142024-12-20T21:31:49.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16152024-12-20T21:31:49.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16162024-12-20T21:31:49.557ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1408, tv_nsec: 836636175 } })
16172024-12-20T21:31:49.557ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
16182024-12-20T21:31:49.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16192024-12-20T21:31:49.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16202024-12-20T21:31:49.565ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16212024-12-20T21:31:49.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16222024-12-20T21:31:49.566ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1408, tv_nsec: 845941804 } })
16232024-12-20T21:31:49.566ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
16242024-12-20T21:31:49.578ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16252024-12-20T21:31:49.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07470679-ad8f-4477-95b2-4b6a76b37277 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
16262024-12-20T21:31:49.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16272024-12-20T21:31:49.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07470679-ad8f-4477-95b2-4b6a76b37277 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
16282024-12-20T21:31:49.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2842 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07470679-ad8f-4477-95b2-4b6a76b37277 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
16292024-12-20T21:31:49.582ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16302024-12-20T21:31:49.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
16312024-12-20T21:31:49.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16322024-12-20T21:31:49.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16332024-12-20T21:31:49.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16342024-12-20T21:31:49.585ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 46.440782ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16352024-12-20T21:31:49.587ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16362024-12-20T21:31:49.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16372024-12-20T21:31:49.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16382024-12-20T21:31:49.588ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.739884ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
16392024-12-20T21:31:49.590ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 50.998633ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16402024-12-20T21:31:49.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16412024-12-20T21:31:49.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16422024-12-20T21:31:49.595ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.496654ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
16432024-12-20T21:31:49.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16442024-12-20T21:31:49.598ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16452024-12-20T21:31:49.598ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
16462024-12-20T21:31:49.598ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16472024-12-20T21:31:49.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16482024-12-20T21:31:49.598ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16492024-12-20T21:31:49.598ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
16502024-12-20T21:31:49.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16512024-12-20T21:31:49.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16522024-12-20T21:31:49.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16532024-12-20T21:31:49.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16542024-12-20T21:31:49.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16552024-12-20T21:31:49.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16562024-12-20T21:31:49.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16572024-12-20T21:31:49.608ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
16582024-12-20T21:31:49.608ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.948676ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
16592024-12-20T21:31:49.612ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
16602024-12-20T21:31:49.612ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.198252ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
16612024-12-20T21:31:49.613ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16622024-12-20T21:31:49.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16632024-12-20T21:31:49.619ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16642024-12-20T21:31:49.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16652024-12-20T21:31:49.622ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16662024-12-20T21:31:49.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16672024-12-20T21:31:49.623ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16682024-12-20T21:31:49.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c74ff24-982c-40fd-86fd-ef04898c5922, lookup_type: ById(8c74ff24-982c-40fd-86fd-ef04898c5922) } result = Ok(())
16692024-12-20T21:31:49.626ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16702024-12-20T21:31:49.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16712024-12-20T21:31:49.627ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16722024-12-20T21:31:49.627ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
16732024-12-20T21:31:49.627ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16742024-12-20T21:31:49.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16752024-12-20T21:31:49.629ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 89.938797ms iteration = 20 status = 0
16762024-12-20T21:31:49.631ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
16772024-12-20T21:31:49.631ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16782024-12-20T21:31:49.631ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8afa08ff-4cc1-4198-93a0-830cf5885a23", "content-length": "26", "date": "Fri, 20 Dec 2024 21:31:48 GMT"} })
16792024-12-20T21:31:49.631ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16802024-12-20T21:31:49.632ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16812024-12-20T21:31:49.633ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
16822024-12-20T21:31:49.633ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16832024-12-20T21:31:49.634ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c3caa0b-a365-4f1e-8c90-1a1eb4daebc7", "content-length": "26", "date": "Fri, 20 Dec 2024 21:31:48 GMT"} })
16842024-12-20T21:31:49.634ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16852024-12-20T21:31:49.636ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16862024-12-20T21:31:49.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 98.742685ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16872024-12-20T21:31:49.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 101.646779ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
16882024-12-20T21:31:49.642ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac zone_address = fd00:1122:3344:101::2
16892024-12-20T21:31:49.642ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16902024-12-20T21:31:49.642ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b76ca4c-fe32-4989-a61d-09a6d430a728", "content-length": "26", "date": "Fri, 20 Dec 2024 21:31:48 GMT"} })
16912024-12-20T21:31:49.642ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16922024-12-20T21:31:49.644ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
16932024-12-20T21:31:49.655ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16942024-12-20T21:31:49.656ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16952024-12-20T21:31:49.656ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 116.433991ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
16962024-12-20T21:31:49.671ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16972024-12-20T21:31:49.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16982024-12-20T21:31:49.673ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16992024-12-20T21:31:49.675ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17002024-12-20T21:31:49.675ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17012024-12-20T21:31:49.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17022024-12-20T21:31:49.696ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 157.036562ms iteration = 22 status = {"physical_disks_added":0}
17032024-12-20T21:31:49.782ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
17042024-12-20T21:31:49.782ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17052024-12-20T21:31:49.783ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0defe6c2-7543-4bd0-b552-e1bc8956b08f", "content-length": "372", "date": "Fri, 20 Dec 2024 21:31:49 GMT"} })
17062024-12-20T21:31:49.783ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17072024-12-20T21:31:49.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17082024-12-20T21:31:49.784ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17092024-12-20T21:31:49.786ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17102024-12-20T21:31:49.786ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17112024-12-20T21:31:49.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17122024-12-20T21:31:49.823ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
17132024-12-20T21:31:49.823ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
17142024-12-20T21:31:49.823ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0a25bb06-ba21-4205-9f9a-e2bd3b9b9d3f", "date": "Fri, 20 Dec 2024 21:31:49 GMT"} })
17152024-12-20T21:31:49.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17162024-12-20T21:31:49.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17172024-12-20T21:31:49.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17182024-12-20T21:31:49.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17192024-12-20T21:31:49.829ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17202024-12-20T21:31:49.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17212024-12-20T21:31:49.833ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
17222024-12-20T21:31:49.833ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17232024-12-20T21:31:49.833ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7bf8c899-0d13-4ab5-b27b-66f99e599f0b", "date": "Fri, 20 Dec 2024 21:31:49 GMT"} })
17242024-12-20T21:31:49.834ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 295.332623ms iteration = 20 status = {}
17252024-12-20T21:31:49.841ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 301.330897ms iteration = 20 status = {}
17262024-12-20T21:31:49.844ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
17272024-12-20T21:31:49.844ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "659110d4-df1e-45ac-bbd0-08c578cbff62", "content-length": "1", "date": "Fri, 20 Dec 2024 21:31:49 GMT"} })
17282024-12-20T21:31:49.846ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17292024-12-20T21:31:49.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17302024-12-20T21:31:49.848ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 308.517848ms iteration = 20 status = null
17312024-12-20T21:31:49.863ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
17322024-12-20T21:31:49.863ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a91748d-411a-4444-946b-c39ba5f65124", "content-length": "691", "date": "Fri, 20 Dec 2024 21:31:49 GMT"} })
17332024-12-20T21:31:49.863ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
17342024-12-20T21:31:49.863ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
17352024-12-20T21:31:49.863ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
17362024-12-20T21:31:49.864ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 325.12024ms iteration = 20 status = {}
17372024-12-20T21:31:49.886ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17382024-12-20T21:31:49.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17392024-12-20T21:31:49.889ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 583388f4-92af-4a10-817c-62f2e9571310, rack_id: a7e68df9-95f5-4fda-aae0-2f46483e29ac, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bacaa666-9eda-4bc8-9ccd-35df228fd476) } rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
17402024-12-20T21:31:49.889ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17412024-12-20T21:31:49.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17422024-12-20T21:31:49.909ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
17432024-12-20T21:31:49.910ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd7d7cbc-dadb-4b5d-b132-521951c45638", "content-length": "134", "date": "Fri, 20 Dec 2024 21:31:49 GMT"} })
17442024-12-20T21:31:49.910ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
17452024-12-20T21:31:49.910ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bacaa666-9eda-4bc8-9ccd-35df228fd476
17462024-12-20T21:31:49.910ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
17472024-12-20T21:31:49.910ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17482024-12-20T21:31:49.910ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17492024-12-20T21:31:49.910ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17502024-12-20T21:31:49.910ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17512024-12-20T21:31:49.910ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17522024-12-20T21:31:49.910ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17532024-12-20T21:31:49.910ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17542024-12-20T21:31:49.910ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
17552024-12-20T21:31:49.910ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17562024-12-20T21:31:49.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17572024-12-20T21:31:49.913ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
17582024-12-20T21:31:49.913ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b5f0242-a6ee-457b-bff3-e4655b0f5c83", "content-length": "2", "date": "Fri, 20 Dec 2024 21:31:49 GMT"} })
17592024-12-20T21:31:49.913ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
17602024-12-20T21:31:49.913ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e3eb2ae-e960-42f6-891f-3cb7d6bb3392", "content-length": "52", "date": "Fri, 20 Dec 2024 21:31:49 GMT"} })
17612024-12-20T21:31:49.913ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
17622024-12-20T21:31:49.913ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
17632024-12-20T21:31:50.028ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3745b1ca-37d5-4d55-b166-2add6afce7a5", "date": "Fri, 20 Dec 2024 21:31:49 GMT"} })
17642024-12-20T21:31:50.028ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch = Switch0
17652024-12-20T21:31:50.028ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
17662024-12-20T21:31:50.028ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "06a03005-5dba-4ab1-b9e6-90053147decb", "content-length": "682", "date": "Fri, 20 Dec 2024 21:31:49 GMT"} })
17672024-12-20T21:31:50.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17682024-12-20T21:31:50.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17692024-12-20T21:31:50.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17702024-12-20T21:31:50.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17712024-12-20T21:31:50.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17722024-12-20T21:31:50.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17732024-12-20T21:31:50.039ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17742024-12-20T21:31:50.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17752024-12-20T21:31:50.046ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 507.05561ms iteration = 20 status = {}
17762024-12-20T21:31:50.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = b6c9a403-5e5c-4436-b7b3-c471b435bd07 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
17772024-12-20T21:31:50.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = b6c9a403-5e5c-4436-b7b3-c471b435bd07 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
17782024-12-20T21:31:50.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3409 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = b6c9a403-5e5c-4436-b7b3-c471b435bd07 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
17792024-12-20T21:31:50.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1ab48059-9fc7-40d0-8832-895c1975638b roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
17802024-12-20T21:31:50.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1ab48059-9fc7-40d0-8832-895c1975638b resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
17812024-12-20T21:31:50.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2637 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1ab48059-9fc7-40d0-8832-895c1975638b response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
17822024-12-20T21:31:51.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 83fb5a34-b40d-4300-a97c-9b2375f74fb3 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
17832024-12-20T21:31:51.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 83fb5a34-b40d-4300-a97c-9b2375f74fb3 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
17842024-12-20T21:31:51.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 83fb5a34-b40d-4300-a97c-9b2375f74fb3 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
17852024-12-20T21:31:52.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 61e659ef-0230-4067-b4b3-355c865fd05f roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
17862024-12-20T21:31:52.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 61e659ef-0230-4067-b4b3-355c865fd05f resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
17872024-12-20T21:31:52.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2731 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 61e659ef-0230-4067-b4b3-355c865fd05f response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
17882024-12-20T21:31:53.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 821cd38f-bacc-4b57-96e5-d1be624ca8a5 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
17892024-12-20T21:31:53.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 821cd38f-bacc-4b57-96e5-d1be624ca8a5 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
17902024-12-20T21:31:53.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 821cd38f-bacc-4b57-96e5-d1be624ca8a5 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
17912024-12-20T21:31:54.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 86e398b9-7d1b-4582-8472-0a53225a24e7 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
17922024-12-20T21:31:54.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 86e398b9-7d1b-4582-8472-0a53225a24e7 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
17932024-12-20T21:31:54.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 86e398b9-7d1b-4582-8472-0a53225a24e7 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
17942024-12-20T21:31:55.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ecca48af-8334-418e-b12f-7b942c5386c7 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
17952024-12-20T21:31:55.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ecca48af-8334-418e-b12f-7b942c5386c7 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
17962024-12-20T21:31:55.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ecca48af-8334-418e-b12f-7b942c5386c7 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
17972024-12-20T21:31:56.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = f7e2e8d1-ba62-4179-b528-92ba83519f8a roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
17982024-12-20T21:31:56.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = f7e2e8d1-ba62-4179-b528-92ba83519f8a resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
17992024-12-20T21:31:56.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2855 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = f7e2e8d1-ba62-4179-b528-92ba83519f8a response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
18002024-12-20T21:31:56.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = 2b2192d7-2ea0-484d-bdcd-2b1fc88b2373 roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
18012024-12-20T21:31:56.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = 2b2192d7-2ea0-484d-bdcd-2b1fc88b2373 resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
18022024-12-20T21:31:56.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1684 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = 2b2192d7-2ea0-484d-bdcd-2b1fc88b2373 response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
18032024-12-20T21:31:56.406ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 624 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 85dbcbfb-e49a-4930-a4ad-74e835095cc7 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
18042024-12-20T21:31:56.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c06753c2-575c-4913-ba1e-9f6dd87572ea roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18052024-12-20T21:31:56.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c06753c2-575c-4913-ba1e-9f6dd87572ea resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18062024-12-20T21:31:56.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c06753c2-575c-4913-ba1e-9f6dd87572ea response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18072024-12-20T21:31:57.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 90baaadd-b6a5-465a-8793-6e8787f9b98b roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18082024-12-20T21:31:57.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 90baaadd-b6a5-465a-8793-6e8787f9b98b resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18092024-12-20T21:31:57.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 90baaadd-b6a5-465a-8793-6e8787f9b98b response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18102024-12-20T21:31:58.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 396b5b58-a73d-4467-8beb-8f4e38a95fe7 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18112024-12-20T21:31:58.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 396b5b58-a73d-4467-8beb-8f4e38a95fe7 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18122024-12-20T21:31:58.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 396b5b58-a73d-4467-8beb-8f4e38a95fe7 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18132024-12-20T21:31:59.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
18142024-12-20T21:31:59.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
18152024-12-20T21:31:59.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18162024-12-20T21:31:59.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18172024-12-20T21:31:59.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18182024-12-20T21:31:59.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18192024-12-20T21:31:59.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18202024-12-20T21:31:59.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18212024-12-20T21:31:59.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18222024-12-20T21:31:59.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18232024-12-20T21:31:59.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18242024-12-20T21:31:59.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18252024-12-20T21:31:59.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18262024-12-20T21:31:59.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
18272024-12-20T21:31:59.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18282024-12-20T21:31:59.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18292024-12-20T21:31:59.561ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
18302024-12-20T21:31:59.561ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.709889ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
18312024-12-20T21:31:59.565ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18322024-12-20T21:31:59.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18332024-12-20T21:31:59.566ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.866364ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18342024-12-20T21:31:59.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ff810edd-180d-4735-9720-81a7e01fc86f roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18352024-12-20T21:31:59.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ff810edd-180d-4735-9720-81a7e01fc86f resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18362024-12-20T21:31:59.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ff810edd-180d-4735-9720-81a7e01fc86f response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18372024-12-20T21:32:00.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7341b0fc-988d-4585-a1c0-08506d66e47c roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18382024-12-20T21:32:00.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7341b0fc-988d-4585-a1c0-08506d66e47c resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18392024-12-20T21:32:00.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7341b0fc-988d-4585-a1c0-08506d66e47c response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18402024-12-20T21:32:01.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c210e39e-4987-48c9-b334-79b8f5c09c1e roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18412024-12-20T21:32:01.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c210e39e-4987-48c9-b334-79b8f5c09c1e resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18422024-12-20T21:32:01.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1911 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c210e39e-4987-48c9-b334-79b8f5c09c1e response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18432024-12-20T21:32:02.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ca38726c-8db0-4c12-9351-7fbb72206e02 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18442024-12-20T21:32:02.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ca38726c-8db0-4c12-9351-7fbb72206e02 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18452024-12-20T21:32:02.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ca38726c-8db0-4c12-9351-7fbb72206e02 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18462024-12-20T21:32:03.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b8e21dc7-34e5-4d1d-9fc7-aa3e1c0d8748 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18472024-12-20T21:32:03.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b8e21dc7-34e5-4d1d-9fc7-aa3e1c0d8748 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18482024-12-20T21:32:03.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b8e21dc7-34e5-4d1d-9fc7-aa3e1c0d8748 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18492024-12-20T21:32:04.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d90ab565-5574-437d-a162-8ca219b132d6 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18502024-12-20T21:32:04.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d90ab565-5574-437d-a162-8ca219b132d6 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18512024-12-20T21:32:04.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d90ab565-5574-437d-a162-8ca219b132d6 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18522024-12-20T21:32:05.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 01f66e1e-39dd-4148-ad71-09ff9600083a roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18532024-12-20T21:32:05.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 01f66e1e-39dd-4148-ad71-09ff9600083a resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18542024-12-20T21:32:05.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 01f66e1e-39dd-4148-ad71-09ff9600083a response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18552024-12-20T21:32:06.405ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 554 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = de49ad7a-a773-4a2c-b486-2db09a44c32e response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
18562024-12-20T21:32:07.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b0fda73c-3b53-462f-bbe0-ca35644749cb roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18572024-12-20T21:32:07.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b0fda73c-3b53-462f-bbe0-ca35644749cb resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18582024-12-20T21:32:07.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2586 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b0fda73c-3b53-462f-bbe0-ca35644749cb response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18592024-12-20T21:32:08.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 69e04102-e4ce-4ad5-b33e-c4f8231afb4c roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18602024-12-20T21:32:08.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 69e04102-e4ce-4ad5-b33e-c4f8231afb4c resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18612024-12-20T21:32:08.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 69e04102-e4ce-4ad5-b33e-c4f8231afb4c response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18622024-12-20T21:32:09.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d79ac5a4-8c53-4962-b40d-5daf71f083eb roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18632024-12-20T21:32:09.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d79ac5a4-8c53-4962-b40d-5daf71f083eb resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18642024-12-20T21:32:09.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1842 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d79ac5a4-8c53-4962-b40d-5daf71f083eb response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18652024-12-20T21:32:09.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
18662024-12-20T21:32:09.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18672024-12-20T21:32:09.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
18682024-12-20T21:32:09.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18692024-12-20T21:32:09.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18702024-12-20T21:32:09.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18712024-12-20T21:32:09.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18722024-12-20T21:32:09.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18732024-12-20T21:32:09.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18742024-12-20T21:32:09.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18752024-12-20T21:32:09.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18762024-12-20T21:32:09.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18772024-12-20T21:32:09.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18782024-12-20T21:32:09.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18792024-12-20T21:32:09.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18802024-12-20T21:32:09.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
18812024-12-20T21:32:09.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18822024-12-20T21:32:09.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18832024-12-20T21:32:09.559ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
18842024-12-20T21:32:09.559ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.927607ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
18852024-12-20T21:32:09.569ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.211627ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18862024-12-20T21:32:10.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2b905d69-7042-46dc-bb53-b0c0d9bcae37 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18872024-12-20T21:32:10.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2b905d69-7042-46dc-bb53-b0c0d9bcae37 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18882024-12-20T21:32:10.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2b905d69-7042-46dc-bb53-b0c0d9bcae37 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18892024-12-20T21:32:11.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 20c83331-68a8-48b9-9641-35c6a0959715 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18902024-12-20T21:32:11.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 20c83331-68a8-48b9-9641-35c6a0959715 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18912024-12-20T21:32:11.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 20c83331-68a8-48b9-9641-35c6a0959715 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18922024-12-20T21:32:12.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9bf4bc4d-dabd-4412-a28c-287e2aa170e5 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18932024-12-20T21:32:12.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9bf4bc4d-dabd-4412-a28c-287e2aa170e5 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18942024-12-20T21:32:12.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2499 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9bf4bc4d-dabd-4412-a28c-287e2aa170e5 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18952024-12-20T21:32:13.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ee5f4861-cda7-46a9-a410-3cb8d251abcd roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18962024-12-20T21:32:13.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ee5f4861-cda7-46a9-a410-3cb8d251abcd resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18972024-12-20T21:32:13.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1522 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ee5f4861-cda7-46a9-a410-3cb8d251abcd response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18982024-12-20T21:32:14.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5299ba87-3295-4e60-aca6-50cc18538761 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
18992024-12-20T21:32:14.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5299ba87-3295-4e60-aca6-50cc18538761 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
19002024-12-20T21:32:14.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5299ba87-3295-4e60-aca6-50cc18538761 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
19012024-12-20T21:32:15.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bc2c7a9a-7c52-4ad2-b127-2d559e59e3e0 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
19022024-12-20T21:32:15.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bc2c7a9a-7c52-4ad2-b127-2d559e59e3e0 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
19032024-12-20T21:32:15.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bc2c7a9a-7c52-4ad2-b127-2d559e59e3e0 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
19042024-12-20T21:32:16.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fc17acef-e6ca-410b-ab65-b922881f73b9 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
19052024-12-20T21:32:16.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fc17acef-e6ca-410b-ab65-b922881f73b9 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
19062024-12-20T21:32:16.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fc17acef-e6ca-410b-ab65-b922881f73b9 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
19072024-12-20T21:32:16.406ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 657 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = bcbee148-7434-46c4-b4bc-eaf53a40c956 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
19082024-12-20T21:32:17.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 202ac01d-11d9-4c54-86d3-b3bb9fea3351 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
19092024-12-20T21:32:17.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 202ac01d-11d9-4c54-86d3-b3bb9fea3351 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
19102024-12-20T21:32:17.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1846 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 202ac01d-11d9-4c54-86d3-b3bb9fea3351 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
19112024-12-20T21:32:18.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6ac364d0-16e3-4551-8f58-f463307049c1 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
19122024-12-20T21:32:18.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6ac364d0-16e3-4551-8f58-f463307049c1 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
19132024-12-20T21:32:18.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1939 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6ac364d0-16e3-4551-8f58-f463307049c1 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
19142024-12-20T21:32:19.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 82fc6ac9-4972-4714-876b-dd3a06e9506d roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
19152024-12-20T21:32:19.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 82fc6ac9-4972-4714-876b-dd3a06e9506d resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
19162024-12-20T21:32:19.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 82fc6ac9-4972-4714-876b-dd3a06e9506d response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
19172024-12-20T21:32:19.538ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
19182024-12-20T21:32:19.538ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
19192024-12-20T21:32:19.538ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19202024-12-20T21:32:19.538ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19212024-12-20T21:32:19.538ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
19222024-12-20T21:32:19.538ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
19232024-12-20T21:32:19.538ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
19242024-12-20T21:32:19.538ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
19252024-12-20T21:32:19.538ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
19262024-12-20T21:32:19.538ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
19272024-12-20T21:32:19.538ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
19282024-12-20T21:32:19.538ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
19292024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19302024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19312024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
19322024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19332024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
19342024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
19352024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
19362024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19372024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
19382024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
19392024-12-20T21:32:19.539ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9112287e-7109-46ca-aa8a-610048d83c82
19402024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.061\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"9112287e-7109-46ca-aa8a-610048d83c82"}
19412024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
19422024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
19432024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
19442024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19452024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19462024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
19472024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
19482024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
19492024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
19502024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19512024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
19522024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
19532024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
19542024-12-20T21:32:19.539ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
19552024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19562024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19572024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19582024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
19592024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
19602024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
19612024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19622024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
19632024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
19642024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
19652024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
19662024-12-20T21:32:19.539ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
19672024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
19682024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
19692024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19702024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
19712024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
19722024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
19732024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
19742024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
19752024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
19762024-12-20T21:32:19.539ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 21:22:19.539250679 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
19772024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
19782024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
19792024-12-20T21:32:19.539ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
19802024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
19812024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
19822024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
19832024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19842024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
19852024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
19862024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19872024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19882024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19892024-12-20T21:32:19.539ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
19902024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19912024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
19922024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19932024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
19942024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19952024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19962024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19972024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19982024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19992024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
20002024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
20012024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20022024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20032024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20042024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
20052024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20062024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20072024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20082024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
20092024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
20102024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20112024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
20122024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
20132024-12-20T21:32:19.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20142024-12-20T21:32:19.539ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("065cea45-0eca-4287-90a0-2c3c20ec32f8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b24cb173-c3a3-4237-abe6-0e7953a415e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b24cb173-c3a3-4237-abe6-0e7953a415e5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1438, tv_nsec: 819355465 } })
20152024-12-20T21:32:19.540ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4565f09e-ee63-469d-bb6e-3ccd4abd01fe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("73abfaca-4f35-4f97-9980-1890d6dba8fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3f6b067-d10e-44b3-9f21-f8e5a96a2b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3f6b067-d10e-44b3-9f21-f8e5a96a2b37.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1438, tv_nsec: 819417217 } })
20162024-12-20T21:32:19.540ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
20172024-12-20T21:32:19.540ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.428592ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
20182024-12-20T21:32:19.540ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
20192024-12-20T21:32:19.540ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.458873ms iteration = 11 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
20202024-12-20T21:32:19.541ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1438, tv_nsec: 820876449 } })
20212024-12-20T21:32:19.541ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
20222024-12-20T21:32:19.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20232024-12-20T21:32:19.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20242024-12-20T21:32:19.543ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.172054ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20252024-12-20T21:32:19.544ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1438, tv_nsec: 823898667 } })
20262024-12-20T21:32:19.544ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
20272024-12-20T21:32:19.544ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20282024-12-20T21:32:19.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20292024-12-20T21:32:19.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20302024-12-20T21:32:19.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20312024-12-20T21:32:19.547ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20322024-12-20T21:32:19.547ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20332024-12-20T21:32:19.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20342024-12-20T21:32:19.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
20352024-12-20T21:32:19.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20362024-12-20T21:32:19.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20372024-12-20T21:32:19.550ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20382024-12-20T21:32:19.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20392024-12-20T21:32:19.551ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.349337ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
20402024-12-20T21:32:19.552ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20412024-12-20T21:32:19.552ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
20422024-12-20T21:32:19.552ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20432024-12-20T21:32:19.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20442024-12-20T21:32:19.553ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.936252ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
20452024-12-20T21:32:19.553ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 21:22:19.539250679 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
20462024-12-20T21:32:19.553ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.517795ms iteration = 11 status = {"expiration":"2024-12-20T21:22:19.539250679Z","pruned":[]}
20472024-12-20T21:32:19.553ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20482024-12-20T21:32:19.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20492024-12-20T21:32:19.555ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20502024-12-20T21:32:19.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20512024-12-20T21:32:19.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20522024-12-20T21:32:19.558ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20532024-12-20T21:32:19.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20542024-12-20T21:32:19.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20552024-12-20T21:32:19.558ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1438, tv_nsec: 837586424 } })
20562024-12-20T21:32:19.558ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
20572024-12-20T21:32:19.560ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20582024-12-20T21:32:19.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20592024-12-20T21:32:19.560ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20602024-12-20T21:32:19.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20612024-12-20T21:32:19.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20622024-12-20T21:32:19.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20632024-12-20T21:32:19.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20642024-12-20T21:32:19.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20652024-12-20T21:32:19.587ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20662024-12-20T21:32:19.590ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
20672024-12-20T21:32:19.590ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20682024-12-20T21:32:19.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20692024-12-20T21:32:19.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20702024-12-20T21:32:19.594ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20712024-12-20T21:32:19.595ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20722024-12-20T21:32:19.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
20732024-12-20T21:32:19.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20742024-12-20T21:32:19.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20752024-12-20T21:32:19.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20762024-12-20T21:32:19.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20772024-12-20T21:32:19.599ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
20782024-12-20T21:32:19.599ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 60.344184ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
20792024-12-20T21:32:19.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
20802024-12-20T21:32:19.599ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
20812024-12-20T21:32:19.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20822024-12-20T21:32:19.599ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20832024-12-20T21:32:19.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
20842024-12-20T21:32:19.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20852024-12-20T21:32:19.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20862024-12-20T21:32:19.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20872024-12-20T21:32:19.600ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.077592ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
20882024-12-20T21:32:19.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20892024-12-20T21:32:19.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20902024-12-20T21:32:19.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20912024-12-20T21:32:19.602ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
20922024-12-20T21:32:19.602ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
20932024-12-20T21:32:19.602ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 63.742839ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
20942024-12-20T21:32:19.603ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 64.127747ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20952024-12-20T21:32:19.603ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20962024-12-20T21:32:19.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
20972024-12-20T21:32:19.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20982024-12-20T21:32:19.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20992024-12-20T21:32:19.605ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
21002024-12-20T21:32:19.605ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
21012024-12-20T21:32:19.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
21022024-12-20T21:32:19.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.80834ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21032024-12-20T21:32:19.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21042024-12-20T21:32:19.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21052024-12-20T21:32:19.608ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21062024-12-20T21:32:19.608ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
21072024-12-20T21:32:19.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21082024-12-20T21:32:19.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21092024-12-20T21:32:19.612ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
21102024-12-20T21:32:19.612ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
21112024-12-20T21:32:19.612ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
21122024-12-20T21:32:19.612ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21132024-12-20T21:32:19.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21142024-12-20T21:32:19.628ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
21152024-12-20T21:32:19.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
21162024-12-20T21:32:19.630ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
21172024-12-20T21:32:19.630ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
21182024-12-20T21:32:19.630ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
21192024-12-20T21:32:19.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21202024-12-20T21:32:19.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21212024-12-20T21:32:19.700ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
21222024-12-20T21:32:19.722ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
21232024-12-20T21:32:19.722ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21242024-12-20T21:32:19.723ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3779e0b8-6352-413d-b7c0-df81b3daf5ae", "content-length": "26", "date": "Fri, 20 Dec 2024 21:32:18 GMT"} })
21252024-12-20T21:32:19.723ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21262024-12-20T21:32:19.725ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21272024-12-20T21:32:19.756ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
21282024-12-20T21:32:19.756ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21292024-12-20T21:32:19.757ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "10d6cb20-8590-43a4-af5f-6e1c5216b560", "content-length": "372", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
21302024-12-20T21:32:19.757ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21312024-12-20T21:32:19.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21322024-12-20T21:32:19.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21332024-12-20T21:32:19.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21342024-12-20T21:32:19.759ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21352024-12-20T21:32:19.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21362024-12-20T21:32:19.760ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21372024-12-20T21:32:19.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21382024-12-20T21:32:19.761ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21392024-12-20T21:32:19.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21402024-12-20T21:32:19.761ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21412024-12-20T21:32:19.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21422024-12-20T21:32:19.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21432024-12-20T21:32:19.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21442024-12-20T21:32:19.763ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21452024-12-20T21:32:19.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21462024-12-20T21:32:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21472024-12-20T21:32:19.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21482024-12-20T21:32:19.767ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(94c9c946-590c-4030-b9b0-ee7bbfa84ab9, 0), (37c2a321-f680-4bcf-88a9-30df55f1ce17, 0), (193cc981-bf7a-4a3d-8be7-fabd8196bf01, 0), (91c98cde-7ffa-44a9-8974-899b426c17cc, 0)] collection_id = 94c9c946-590c-4030-b9b0-ee7bbfa84ab9
21492024-12-20T21:32:19.767ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
21502024-12-20T21:32:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21512024-12-20T21:32:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
21522024-12-20T21:32:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21532024-12-20T21:32:19.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21542024-12-20T21:32:19.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21552024-12-20T21:32:19.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21562024-12-20T21:32:19.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
21572024-12-20T21:32:19.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21582024-12-20T21:32:19.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21592024-12-20T21:32:19.790ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
21602024-12-20T21:32:19.790ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 251.253484ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
21612024-12-20T21:32:19.793ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 254.345664ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21622024-12-20T21:32:19.798ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
21632024-12-20T21:32:19.798ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
21642024-12-20T21:32:19.798ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 259.376646ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
21652024-12-20T21:32:19.801ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
21662024-12-20T21:32:19.801ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 261.887212ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
21672024-12-20T21:32:19.803ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21682024-12-20T21:32:19.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21692024-12-20T21:32:19.804ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
21702024-12-20T21:32:19.804ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4aec9cd8-ad86-40dc-bdd7-2394e3237b38 dns_zone_name = oxide.test found_so_far = 0 version = 2
21712024-12-20T21:32:19.804ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21722024-12-20T21:32:19.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21732024-12-20T21:32:19.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21742024-12-20T21:32:19.808ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21752024-12-20T21:32:19.808ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
21762024-12-20T21:32:19.808ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 269.332629ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
21772024-12-20T21:32:19.808ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21782024-12-20T21:32:19.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21792024-12-20T21:32:19.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21802024-12-20T21:32:19.809ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21812024-12-20T21:32:19.810ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21822024-12-20T21:32:19.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21832024-12-20T21:32:19.811ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
21842024-12-20T21:32:19.811ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c58feff7-51f2-445e-83fd-a0c3a102f4ed dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
21852024-12-20T21:32:19.811ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21862024-12-20T21:32:19.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21872024-12-20T21:32:19.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
21882024-12-20T21:32:19.812ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21892024-12-20T21:32:19.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21902024-12-20T21:32:19.812ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21912024-12-20T21:32:19.812ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 274.007734ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
21922024-12-20T21:32:19.814ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21932024-12-20T21:32:19.814ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21942024-12-20T21:32:19.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21952024-12-20T21:32:19.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21962024-12-20T21:32:19.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21972024-12-20T21:32:19.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21982024-12-20T21:32:19.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21992024-12-20T21:32:19.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22002024-12-20T21:32:19.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
22012024-12-20T21:32:19.818ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22022024-12-20T21:32:19.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22032024-12-20T21:32:19.820ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22042024-12-20T21:32:19.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22052024-12-20T21:32:19.821ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c58feff7-51f2-445e-83fd-a0c3a102f4ed dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
22062024-12-20T21:32:19.821ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
22072024-12-20T21:32:19.821ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 21:23:04.517297 UTC dns_group = internal generation = 1
22082024-12-20T21:32:19.821ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 282.363471ms iteration = 11 status = {"generation":1}
22092024-12-20T21:32:19.822ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22102024-12-20T21:32:19.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22112024-12-20T21:32:19.830ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
22122024-12-20T21:32:19.830ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
22132024-12-20T21:32:19.831ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e5367e2c-7956-4f89-9838-2253cc28500c", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
22142024-12-20T21:32:19.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22152024-12-20T21:32:19.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22162024-12-20T21:32:19.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22172024-12-20T21:32:19.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22182024-12-20T21:32:19.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22192024-12-20T21:32:19.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22202024-12-20T21:32:19.840ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22212024-12-20T21:32:19.842ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
22222024-12-20T21:32:19.842ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22232024-12-20T21:32:19.843ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5c140e71-520e-4993-b188-d80765c16b64", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
22242024-12-20T21:32:19.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c74ff24-982c-40fd-86fd-ef04898c5922, lookup_type: ById(8c74ff24-982c-40fd-86fd-ef04898c5922) } result = Ok(())
22252024-12-20T21:32:19.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22262024-12-20T21:32:19.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22272024-12-20T21:32:19.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22282024-12-20T21:32:19.845ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 306.056433ms iteration = 21 status = {}
22292024-12-20T21:32:19.845ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 306.598335ms iteration = 21 status = 0
22302024-12-20T21:32:19.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22312024-12-20T21:32:19.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22322024-12-20T21:32:19.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22332024-12-20T21:32:19.849ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 94c9c946-590c-4030-b9b0-ee7bbfa84ab9 file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
22342024-12-20T21:32:19.849ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
22352024-12-20T21:32:19.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
22362024-12-20T21:32:19.851ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4aec9cd8-ad86-40dc-bdd7-2394e3237b38 dns_zone_name = oxide.test found_so_far = 1 version = 2
22372024-12-20T21:32:19.851ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
22382024-12-20T21:32:19.851ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 21:23:05.526309 UTC dns_group = external generation = 2
22392024-12-20T21:32:19.851ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 312.064408ms iteration = 11 status = {"generation":2}
22402024-12-20T21:32:19.853ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(37c2a321-f680-4bcf-88a9-30df55f1ce17, 0), (193cc981-bf7a-4a3d-8be7-fabd8196bf01, 0), (91c98cde-7ffa-44a9-8974-899b426c17cc, 0)]
22412024-12-20T21:32:19.854ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1439, tv_nsec: 133850378 } })
22422024-12-20T21:32:19.858ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22432024-12-20T21:32:19.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22442024-12-20T21:32:19.860ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22452024-12-20T21:32:19.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
22462024-12-20T21:32:19.862ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22472024-12-20T21:32:19.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22482024-12-20T21:32:19.868ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22492024-12-20T21:32:19.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
22502024-12-20T21:32:19.872ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22512024-12-20T21:32:19.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22522024-12-20T21:32:19.874ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22532024-12-20T21:32:19.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22542024-12-20T21:32:19.875ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22552024-12-20T21:32:19.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22562024-12-20T21:32:19.875ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22572024-12-20T21:32:19.877ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22582024-12-20T21:32:19.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22592024-12-20T21:32:19.877ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22602024-12-20T21:32:19.877ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22612024-12-20T21:32:19.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22622024-12-20T21:32:19.879ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22632024-12-20T21:32:19.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22642024-12-20T21:32:19.881ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22652024-12-20T21:32:19.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22662024-12-20T21:32:19.883ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22672024-12-20T21:32:19.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22682024-12-20T21:32:19.886ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22692024-12-20T21:32:19.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22702024-12-20T21:32:19.887ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22712024-12-20T21:32:19.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
22722024-12-20T21:32:19.892ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22732024-12-20T21:32:19.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22742024-12-20T21:32:19.896ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
22752024-12-20T21:32:19.896ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 357.045555ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
22762024-12-20T21:32:19.908ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22772024-12-20T21:32:19.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22782024-12-20T21:32:19.915ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T21:22:10.640928Z, time_modified: 2024-12-20T21:22:10.640928Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, db_silo: Silo { identity: SiloIdentity { id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T21:23:05.471312Z, time_modified: 2024-12-20T21:23:05.471312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, db_silo: Silo { identity: SiloIdentity { id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T21:23:05.471312Z, time_modified: 2024-12-20T21:23:05.471312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b" }] }) }
22792024-12-20T21:32:19.916ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 377.188518ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"66e8bce1-b95a-4433-886f-e35fda6d9a14","tls_certs":["4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b"]}},"default_endpoint":{"silo_id":"66e8bce1-b95a-4433-886f-e35fda6d9a14","tls_certs":["4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
22802024-12-20T21:32:19.917ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22812024-12-20T21:32:19.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22822024-12-20T21:32:19.921ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22832024-12-20T21:32:19.921ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
22842024-12-20T21:32:19.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22852024-12-20T21:32:19.923ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22862024-12-20T21:32:19.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22872024-12-20T21:32:19.927ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22882024-12-20T21:32:19.930ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22892024-12-20T21:32:19.930ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22902024-12-20T21:32:19.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22912024-12-20T21:32:19.948ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
22922024-12-20T21:32:19.948ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22932024-12-20T21:32:19.949ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc3131aa-4aea-4d54-81fa-a51435e4862e", "content-length": "26", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
22942024-12-20T21:32:19.949ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22952024-12-20T21:32:19.952ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22962024-12-20T21:32:19.953ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 413.991593ms iteration = 23 status = {"physical_disks_added":0}
22972024-12-20T21:32:19.957ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac zone_address = fd00:1122:3344:101::2
22982024-12-20T21:32:19.958ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22992024-12-20T21:32:19.958ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d907135-25a0-4bcb-885f-94efe609c97e", "content-length": "26", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23002024-12-20T21:32:19.958ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23012024-12-20T21:32:19.961ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
23022024-12-20T21:32:19.978ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23032024-12-20T21:32:19.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23042024-12-20T21:32:19.980ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23052024-12-20T21:32:19.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23062024-12-20T21:32:19.991ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
23072024-12-20T21:32:20.015ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23082024-12-20T21:32:20.018ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
23092024-12-20T21:32:20.019ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "32b86567-50d5-4133-98ae-39982230367a", "content-length": "1", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23102024-12-20T21:32:20.020ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23112024-12-20T21:32:20.021ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
23122024-12-20T21:32:20.021ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23132024-12-20T21:32:20.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23142024-12-20T21:32:20.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23152024-12-20T21:32:20.023ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 484.494884ms iteration = 21 status = null
23162024-12-20T21:32:20.023ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23172024-12-20T21:32:20.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23182024-12-20T21:32:20.025ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23192024-12-20T21:32:20.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23202024-12-20T21:32:20.027ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23212024-12-20T21:32:20.033ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
23222024-12-20T21:32:20.033ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23232024-12-20T21:32:20.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23242024-12-20T21:32:20.040ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23252024-12-20T21:32:20.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23262024-12-20T21:32:20.044ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23272024-12-20T21:32:20.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23282024-12-20T21:32:20.049ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23292024-12-20T21:32:20.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23302024-12-20T21:32:20.072ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
23312024-12-20T21:32:20.072ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
23322024-12-20T21:32:20.072ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
23332024-12-20T21:32:20.072ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e00a37f-38fa-4229-abad-45e25a0f2298", "content-length": "476", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23342024-12-20T21:32:20.072ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
23352024-12-20T21:32:20.072ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2dd8de1e-aa99-42b0-937d-4d9eff115283", "content-length": "734", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23362024-12-20T21:32:20.072ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
23372024-12-20T21:32:20.073ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ede8b9f-a82d-43fe-a149-8352ee010fd4", "content-length": "111", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23382024-12-20T21:32:20.073ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
23392024-12-20T21:32:20.073ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e7eb68b-6a40-4dbe-a94f-7e6f49ad15ce", "content-length": "111", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23402024-12-20T21:32:20.073ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
23412024-12-20T21:32:20.073ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "96e71b28-3529-412a-bb05-40e2dc248e2f", "content-length": "167", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23422024-12-20T21:32:20.073ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
23432024-12-20T21:32:20.074ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f389e25-54b0-4c98-ac4d-ec26a1368828", "content-length": "167", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23442024-12-20T21:32:20.074ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
23452024-12-20T21:32:20.074ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee473f02-03b5-433d-8667-44bb289196fa", "content-length": "175", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23462024-12-20T21:32:20.074ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
23472024-12-20T21:32:20.074ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "360f5458-024d-4b5a-9f2e-5fcc42d5f52c", "content-length": "175", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23482024-12-20T21:32:20.074ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
23492024-12-20T21:32:20.074ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "73854f21-145d-4324-9eff-24795407bb58", "content-length": "702", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23502024-12-20T21:32:20.074ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
23512024-12-20T21:32:20.075ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf94ab8d-38ce-47de-926e-ac7971f51f60", "content-length": "727", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23522024-12-20T21:32:20.075ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
23532024-12-20T21:32:20.075ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f2613e1-ba2e-4c4f-b929-41d9599b3691", "content-length": "729", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23542024-12-20T21:32:20.075ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
23552024-12-20T21:32:20.075ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b3812f7-5e5d-42f9-b433-fdf19fb8322d", "content-length": "728", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23562024-12-20T21:32:20.075ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
23572024-12-20T21:32:20.075ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9be009dc-230a-41c5-b74b-e925e2919f47", "content-length": "722", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23582024-12-20T21:32:20.075ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
23592024-12-20T21:32:20.075ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "93074268-9ad2-4903-8aa9-5aa627f6f518", "content-length": "109", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23602024-12-20T21:32:20.075ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
23612024-12-20T21:32:20.076ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "03111833-8384-4e24-8fc8-4e578458f779", "content-length": "109", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23622024-12-20T21:32:20.076ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
23632024-12-20T21:32:20.076ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b56c92b1-553e-4126-99a3-0b6c29deb07f", "content-length": "169", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23642024-12-20T21:32:20.076ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
23652024-12-20T21:32:20.076ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c2867d8-f86f-482d-8997-a7a89b1f5832", "content-length": "169", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23662024-12-20T21:32:20.076ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
23672024-12-20T21:32:20.076ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "127fd961-5780-49ad-8451-394ab54903da", "content-length": "178", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23682024-12-20T21:32:20.076ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
23692024-12-20T21:32:20.077ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc37a5bf-b9b0-40ce-a130-d96485bcaf58", "content-length": "178", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23702024-12-20T21:32:20.077ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
23712024-12-20T21:32:20.077ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "73353d60-1e58-4016-988d-e82e8ced1e16", "content-length": "702", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23722024-12-20T21:32:20.077ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
23732024-12-20T21:32:20.077ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d0c662b-7656-4dd3-a516-5ce967d7be31", "content-length": "727", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23742024-12-20T21:32:20.077ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
23752024-12-20T21:32:20.077ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "40645058-73a1-4350-b3f7-a2fec989f91e", "content-length": "729", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23762024-12-20T21:32:20.077ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
23772024-12-20T21:32:20.077ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "92747188-a19b-409f-9267-2e35b4029fcd", "content-length": "728", "date": "Fri, 20 Dec 2024 21:32:20 GMT"} })
23782024-12-20T21:32:20.077ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23792024-12-20T21:32:20.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
23802024-12-20T21:32:20.096ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
23812024-12-20T21:32:20.096ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ae4cdb39-3ce4-47d0-8bea-382ad7bffe82", "date": "Fri, 20 Dec 2024 21:32:20 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
23822024-12-20T21:32:20.096ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
23832024-12-20T21:32:20.098ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "988853b9-9415-4a83-9202-1ba5907dba53", "date": "Fri, 20 Dec 2024 21:32:20 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
23842024-12-20T21:32:20.098ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
23852024-12-20T21:32:20.099ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
23862024-12-20T21:32:20.099ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 560.16281ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
23872024-12-20T21:32:20.104ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 565.48279ms iteration = 21 status = {}
23882024-12-20T21:32:20.134ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
23892024-12-20T21:32:20.135ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "2ecf0485-6e37-4e60-ae3f-3b0ba55e2151", "date": "Fri, 20 Dec 2024 21:32:20 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
23902024-12-20T21:32:20.135ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
23912024-12-20T21:32:20.137ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "cc895df7-36d7-4a6e-a95e-ed456d1e328f", "date": "Fri, 20 Dec 2024 21:32:20 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
23922024-12-20T21:32:20.137ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
23932024-12-20T21:32:20.139ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b7303078-2feb-41f4-93bd-246e7f547796", "date": "Fri, 20 Dec 2024 21:32:20 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
23942024-12-20T21:32:20.139ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
23952024-12-20T21:32:20.140ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
23962024-12-20T21:32:20.140ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 601.942607ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
23972024-12-20T21:32:20.141ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
23982024-12-20T21:32:20.141ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "eefe9424-425a-41e2-a1de-41a46c8c0364", "content-length": "691", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
23992024-12-20T21:32:20.141ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
24002024-12-20T21:32:20.141ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
24012024-12-20T21:32:20.141ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
24022024-12-20T21:32:20.142ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 603.646145ms iteration = 21 status = {}
24032024-12-20T21:32:20.143ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24042024-12-20T21:32:20.144ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24052024-12-20T21:32:20.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24062024-12-20T21:32:20.145ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
24072024-12-20T21:32:20.145ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
24082024-12-20T21:32:20.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
24092024-12-20T21:32:20.145ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24102024-12-20T21:32:20.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24112024-12-20T21:32:20.147ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24122024-12-20T21:32:20.147ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24132024-12-20T21:32:20.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24142024-12-20T21:32:20.148ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24152024-12-20T21:32:20.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24162024-12-20T21:32:20.149ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
24172024-12-20T21:32:20.149ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
24182024-12-20T21:32:20.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
24192024-12-20T21:32:20.150ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24202024-12-20T21:32:20.153ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
24212024-12-20T21:32:20.153ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24222024-12-20T21:32:20.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24232024-12-20T21:32:20.155ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24242024-12-20T21:32:20.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24252024-12-20T21:32:20.156ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24262024-12-20T21:32:20.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24272024-12-20T21:32:20.157ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24282024-12-20T21:32:20.161ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
24292024-12-20T21:32:20.161ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24302024-12-20T21:32:20.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24312024-12-20T21:32:20.208ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
24322024-12-20T21:32:20.208ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
24332024-12-20T21:32:20.210ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 3cdfaf5a-6ab2-4340-badd-90537467f215, kind: Service { id: 1ab9e34a-bb03-4bfb-a926-0dc397c4d4ad }, name: Name("nexus-1ab9e34a-bb03-4bfb-a926-0dc397c4d4ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 196])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ca6d922-6012-48ca-ab83-904f1e9b7f23, kind: Service { id: 0a5aaad3-b9af-4668-92b2-6758e325a2ed }, name: Name("nexus-0a5aaad3-b9af-4668-92b2-6758e325a2ed"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 161])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c6bf8c6b-87e0-4464-b6f8-ef452a4011b6, kind: Service { id: 12bea37a-3ccb-4c9f-8c92-9d6095867a0f }, name: Name("nexus-12bea37a-3ccb-4c9f-8c92-9d6095867a0f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 2d75a81e-7e26-4d89-8f45-4a8a30dcc43e, kind: Service { id: 065cea45-0eca-4287-90a0-2c3c20ec32f8 }, name: Name("external-dns-065cea45-0eca-4287-90a0-2c3c20ec32f8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 64])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fe340e0e-7e73-4e4d-9e13-6fa58166803a, kind: Service { id: b24cb173-c3a3-4237-abe6-0e7953a415e5 }, name: Name("external-dns-b24cb173-c3a3-4237-abe6-0e7953a415e5"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 2])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
24342024-12-20T21:32:20.210ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24352024-12-20T21:32:20.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24362024-12-20T21:32:20.211ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24372024-12-20T21:32:20.213ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
24382024-12-20T21:32:20.213ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24392024-12-20T21:32:20.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24402024-12-20T21:32:20.216ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
24412024-12-20T21:32:20.216ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2d75a81e-7e26-4d89-8f45-4a8a30dcc43e, kind: Service { id: 065cea45-0eca-4287-90a0-2c3c20ec32f8 }, name: Name("external-dns-065cea45-0eca-4287-90a0-2c3c20ec32f8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 64])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fe340e0e-7e73-4e4d-9e13-6fa58166803a, kind: Service { id: b24cb173-c3a3-4237-abe6-0e7953a415e5 }, name: Name("external-dns-b24cb173-c3a3-4237-abe6-0e7953a415e5"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 2])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 3cdfaf5a-6ab2-4340-badd-90537467f215, kind: Service { id: 1ab9e34a-bb03-4bfb-a926-0dc397c4d4ad }, name: Name("nexus-1ab9e34a-bb03-4bfb-a926-0dc397c4d4ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 196])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ca6d922-6012-48ca-ab83-904f1e9b7f23, kind: Service { id: 0a5aaad3-b9af-4668-92b2-6758e325a2ed }, name: Name("nexus-0a5aaad3-b9af-4668-92b2-6758e325a2ed"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 161])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c6bf8c6b-87e0-4464-b6f8-ef452a4011b6, kind: Service { id: 12bea37a-3ccb-4c9f-8c92-9d6095867a0f }, name: Name("nexus-12bea37a-3ccb-4c9f-8c92-9d6095867a0f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
24422024-12-20T21:32:20.216ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
24432024-12-20T21:32:20.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24442024-12-20T21:32:20.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24452024-12-20T21:32:20.221ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 583388f4-92af-4a10-817c-62f2e9571310, rack_id: a7e68df9-95f5-4fda-aae0-2f46483e29ac, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bacaa666-9eda-4bc8-9ccd-35df228fd476) } rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
24462024-12-20T21:32:20.221ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24472024-12-20T21:32:20.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24482024-12-20T21:32:20.235ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
24492024-12-20T21:32:20.235ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8609f13e-a132-4ece-a64c-5b16fdee21ea", "content-length": "134", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
24502024-12-20T21:32:20.235ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
24512024-12-20T21:32:20.235ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bacaa666-9eda-4bc8-9ccd-35df228fd476
24522024-12-20T21:32:20.236ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
24532024-12-20T21:32:20.236ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24542024-12-20T21:32:20.236ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24552024-12-20T21:32:20.236ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24562024-12-20T21:32:20.236ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24572024-12-20T21:32:20.236ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24582024-12-20T21:32:20.236ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24592024-12-20T21:32:20.236ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24602024-12-20T21:32:20.236ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
24612024-12-20T21:32:20.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24622024-12-20T21:32:20.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24632024-12-20T21:32:20.242ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
24642024-12-20T21:32:20.242ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6381cc15-482a-4ab5-955a-959e2e4ac500", "content-length": "2", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
24652024-12-20T21:32:20.242ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
24662024-12-20T21:32:20.243ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e186561-8e93-4433-9499-f8cba51b4c5d", "content-length": "52", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
24672024-12-20T21:32:20.243ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
24682024-12-20T21:32:20.243ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24692024-12-20T21:32:20.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d5ad1b98-4ccf-4b6a-b198-2bf4cbc7377d roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
24702024-12-20T21:32:20.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d5ad1b98-4ccf-4b6a-b198-2bf4cbc7377d resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
24712024-12-20T21:32:20.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10841 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d5ad1b98-4ccf-4b6a-b198-2bf4cbc7377d response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
24722024-12-20T21:32:20.323ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 8c74ff24-982c-40fd-86fd-ef04898c5922, time_created: 2024-12-20T21:23:00.593272Z, time_modified: 2024-12-20T21:23:00.593272Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: a7e68df9-95f5-4fda-aae0-2f46483e29ac, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
24732024-12-20T21:32:20.323ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
24742024-12-20T21:32:20.323ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24752024-12-20T21:32:20.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24762024-12-20T21:32:20.325ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24772024-12-20T21:32:20.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24782024-12-20T21:32:20.328ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24792024-12-20T21:32:20.331ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 8c74ff24-982c-40fd-86fd-ef04898c5922, lookup_type: ById(8c74ff24-982c-40fd-86fd-ef04898c5922) } result = Ok(())
24802024-12-20T21:32:20.388ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24812024-12-20T21:32:20.389ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "bf1555c2-367e-4d2e-82d1-97574880b147", "date": "Fri, 20 Dec 2024 21:32:20 GMT"} })
24822024-12-20T21:32:20.391ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
24832024-12-20T21:32:20.391ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 851.866042ms
24842024-12-20T21:32:20.391ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 851.876612ms iteration = 3 status = {}
24852024-12-20T21:32:20.419ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b013594b-29f0-419f-ad9f-a039563e5304", "date": "Fri, 20 Dec 2024 21:32:20 GMT"} })
24862024-12-20T21:32:20.419ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch = Switch0
24872024-12-20T21:32:20.419ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24882024-12-20T21:32:20.419ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0513bec-ebc9-4edc-b34e-afbb5a621df7", "content-length": "682", "date": "Fri, 20 Dec 2024 21:32:20 GMT"} })
24892024-12-20T21:32:20.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24902024-12-20T21:32:20.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24912024-12-20T21:32:20.424ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24922024-12-20T21:32:20.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24932024-12-20T21:32:20.428ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24942024-12-20T21:32:20.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24952024-12-20T21:32:20.430ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24962024-12-20T21:32:20.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24972024-12-20T21:32:20.438ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 899.637603ms iteration = 21 status = {}
24982024-12-20T21:32:20.542ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa2ddc83-e666-439b-96d2-4bf2f414f5d2", "content-length": "30799", "date": "Fri, 20 Dec 2024 21:32:19 GMT"} })
24992024-12-20T21:32:20.545ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
25002024-12-20T21:32:20.545ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
25012024-12-20T21:32:20.545ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
25022024-12-20T21:32:20.547ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
25032024-12-20T21:32:20.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
25042024-12-20T21:32:20.549ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25052024-12-20T21:32:20.551ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
25062024-12-20T21:32:20.551ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
25072024-12-20T21:32:20.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
25082024-12-20T21:32:20.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 1e7e292d-2250-4e48-ab09-4d6a09d1bfc8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
25092024-12-20T21:32:20.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 1e7e292d-2250-4e48-ab09-4d6a09d1bfc8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
25102024-12-20T21:32:20.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3843 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 1e7e292d-2250-4e48-ab09-4d6a09d1bfc8 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
25112024-12-20T21:32:20.747ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = ff40cb28-79bf-4837-b88a-1e740d01f2e9 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
25122024-12-20T21:32:20.747ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = ff40cb28-79bf-4837-b88a-1e740d01f2e9 time_started = 2024-12-20 21:32:20.072088 UTC
25132024-12-20T21:32:20.747ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.208061689s iteration = 3 status = {"collection_id":"ff40cb28-79bf-4837-b88a-1e740d01f2e9","time_done":"2024-12-20 21:32:20.545230 UTC","time_started":"2024-12-20 21:32:20.072088 UTC"}
25142024-12-20T21:32:20.747ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
25152024-12-20T21:32:20.747ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25162024-12-20T21:32:20.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25172024-12-20T21:32:20.749ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25182024-12-20T21:32:20.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25192024-12-20T21:32:20.752ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25202024-12-20T21:32:20.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25212024-12-20T21:32:20.755ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25222024-12-20T21:32:20.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25232024-12-20T21:32:20.757ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25242024-12-20T21:32:20.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25252024-12-20T21:32:20.759ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25262024-12-20T21:32:20.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25272024-12-20T21:32:20.782ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 34.874062ms iteration = 24 status = {"physical_disks_added":0}
25282024-12-20T21:32:21.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9f768c24-9d5f-4830-a45f-65195364491e roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25292024-12-20T21:32:21.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9f768c24-9d5f-4830-a45f-65195364491e resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25302024-12-20T21:32:21.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2671 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9f768c24-9d5f-4830-a45f-65195364491e response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25312024-12-20T21:32:22.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f95403cc-0417-4e7e-9599-56cfdb3038f7 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25322024-12-20T21:32:22.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f95403cc-0417-4e7e-9599-56cfdb3038f7 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25332024-12-20T21:32:22.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f95403cc-0417-4e7e-9599-56cfdb3038f7 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25342024-12-20T21:32:23.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 721fde23-1d37-4c7d-9d5e-27f01bbe93e8 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25352024-12-20T21:32:23.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 721fde23-1d37-4c7d-9d5e-27f01bbe93e8 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25362024-12-20T21:32:23.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 721fde23-1d37-4c7d-9d5e-27f01bbe93e8 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25372024-12-20T21:32:24.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7520c790-39ae-4380-a952-a61f1217af72 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25382024-12-20T21:32:24.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7520c790-39ae-4380-a952-a61f1217af72 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25392024-12-20T21:32:24.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7520c790-39ae-4380-a952-a61f1217af72 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25402024-12-20T21:32:25.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6c41554b-887c-43ec-a45f-58d17913fcb6 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25412024-12-20T21:32:25.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6c41554b-887c-43ec-a45f-58d17913fcb6 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25422024-12-20T21:32:25.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2640 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6c41554b-887c-43ec-a45f-58d17913fcb6 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25432024-12-20T21:32:26.406ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 678 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 2d44f7a7-087c-4913-b1ff-e85f35a1eaff response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
25442024-12-20T21:32:26.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5d54e50f-95ef-4150-b13c-1ccf7abf84dc roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25452024-12-20T21:32:26.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5d54e50f-95ef-4150-b13c-1ccf7abf84dc resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25462024-12-20T21:32:26.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5d54e50f-95ef-4150-b13c-1ccf7abf84dc response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25472024-12-20T21:32:27.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e8e8d7cf-548d-4348-9bcf-443098fbbf0a roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25482024-12-20T21:32:27.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e8e8d7cf-548d-4348-9bcf-443098fbbf0a resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25492024-12-20T21:32:27.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e8e8d7cf-548d-4348-9bcf-443098fbbf0a response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25502024-12-20T21:32:28.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 485c1986-3fef-4c4c-b35b-88465a68df51 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25512024-12-20T21:32:28.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 485c1986-3fef-4c4c-b35b-88465a68df51 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25522024-12-20T21:32:28.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1645 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 485c1986-3fef-4c4c-b35b-88465a68df51 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25532024-12-20T21:32:29.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 921d01df-ebb4-4633-ba86-0aee9f7cae99 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25542024-12-20T21:32:29.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 921d01df-ebb4-4633-ba86-0aee9f7cae99 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25552024-12-20T21:32:29.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 921d01df-ebb4-4633-ba86-0aee9f7cae99 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25562024-12-20T21:32:29.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
25572024-12-20T21:32:29.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
25582024-12-20T21:32:29.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25592024-12-20T21:32:29.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25602024-12-20T21:32:29.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25612024-12-20T21:32:29.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25622024-12-20T21:32:29.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25632024-12-20T21:32:29.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25642024-12-20T21:32:29.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25652024-12-20T21:32:29.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25662024-12-20T21:32:29.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25672024-12-20T21:32:29.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25682024-12-20T21:32:29.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25692024-12-20T21:32:29.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
25702024-12-20T21:32:29.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25712024-12-20T21:32:29.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25722024-12-20T21:32:29.562ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
25732024-12-20T21:32:29.562ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.716312ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
25742024-12-20T21:32:29.568ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25752024-12-20T21:32:29.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25762024-12-20T21:32:29.596ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.120151ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25772024-12-20T21:32:30.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fc4d7609-cd96-4a14-907e-bca58fba6e5f roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25782024-12-20T21:32:30.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fc4d7609-cd96-4a14-907e-bca58fba6e5f resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25792024-12-20T21:32:30.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fc4d7609-cd96-4a14-907e-bca58fba6e5f response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25802024-12-20T21:32:31.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 77140260-c3a6-406c-bfe7-a70b5f33f20a roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25812024-12-20T21:32:31.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 77140260-c3a6-406c-bfe7-a70b5f33f20a resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25822024-12-20T21:32:31.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 77140260-c3a6-406c-bfe7-a70b5f33f20a response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25832024-12-20T21:32:32.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a0413f86-2386-44c6-bcad-37371d887d2b roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25842024-12-20T21:32:32.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a0413f86-2386-44c6-bcad-37371d887d2b resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25852024-12-20T21:32:32.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a0413f86-2386-44c6-bcad-37371d887d2b response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25862024-12-20T21:32:33.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 94881252-5065-49dc-9e3a-b859db728a91 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25872024-12-20T21:32:33.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 94881252-5065-49dc-9e3a-b859db728a91 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25882024-12-20T21:32:33.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 94881252-5065-49dc-9e3a-b859db728a91 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25892024-12-20T21:32:34.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bfdd19e3-283f-4d1f-b164-8ab4ed9f9c5a roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25902024-12-20T21:32:34.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bfdd19e3-283f-4d1f-b164-8ab4ed9f9c5a resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25912024-12-20T21:32:34.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bfdd19e3-283f-4d1f-b164-8ab4ed9f9c5a response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25922024-12-20T21:32:35.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1196da16-3527-41b5-81f3-02d2a3f9c9e8 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25932024-12-20T21:32:35.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1196da16-3527-41b5-81f3-02d2a3f9c9e8 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25942024-12-20T21:32:35.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1196da16-3527-41b5-81f3-02d2a3f9c9e8 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25952024-12-20T21:32:36.406ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 549 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 2baa4f6d-f62d-4f09-889e-6e8226e54f27 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
25962024-12-20T21:32:36.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 111c51c6-5d19-408c-83c1-9253a5c3937c roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25972024-12-20T21:32:36.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 111c51c6-5d19-408c-83c1-9253a5c3937c resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25982024-12-20T21:32:36.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 111c51c6-5d19-408c-83c1-9253a5c3937c response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
25992024-12-20T21:32:37.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b674b36e-86f3-4f0d-bbca-f62d605614f4 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26002024-12-20T21:32:37.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b674b36e-86f3-4f0d-bbca-f62d605614f4 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26012024-12-20T21:32:37.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1725 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b674b36e-86f3-4f0d-bbca-f62d605614f4 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26022024-12-20T21:32:38.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4cdf40e7-0337-4d55-b342-4eb7ca0b8498 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26032024-12-20T21:32:38.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4cdf40e7-0337-4d55-b342-4eb7ca0b8498 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26042024-12-20T21:32:38.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1792 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4cdf40e7-0337-4d55-b342-4eb7ca0b8498 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26052024-12-20T21:32:39.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
26062024-12-20T21:32:39.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26072024-12-20T21:32:39.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
26082024-12-20T21:32:39.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26092024-12-20T21:32:39.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26102024-12-20T21:32:39.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26112024-12-20T21:32:39.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26122024-12-20T21:32:39.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26132024-12-20T21:32:39.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26142024-12-20T21:32:39.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26152024-12-20T21:32:39.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26162024-12-20T21:32:39.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26172024-12-20T21:32:39.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26182024-12-20T21:32:39.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26192024-12-20T21:32:39.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26202024-12-20T21:32:39.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
26212024-12-20T21:32:39.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26222024-12-20T21:32:39.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26232024-12-20T21:32:39.563ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
26242024-12-20T21:32:39.563ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.345154ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
26252024-12-20T21:32:39.570ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.24205ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26262024-12-20T21:32:39.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2c44fea5-8d27-4ec5-a7d3-370cafc93c74 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26272024-12-20T21:32:39.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2c44fea5-8d27-4ec5-a7d3-370cafc93c74 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26282024-12-20T21:32:39.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2c44fea5-8d27-4ec5-a7d3-370cafc93c74 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26292024-12-20T21:32:40.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 04e73b3d-e1d3-4053-809b-dace31b0aaf2 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26302024-12-20T21:32:40.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 04e73b3d-e1d3-4053-809b-dace31b0aaf2 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26312024-12-20T21:32:40.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 04e73b3d-e1d3-4053-809b-dace31b0aaf2 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26322024-12-20T21:32:41.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = d6a55539-1473-464e-8945-40b3fc0a512c roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
26332024-12-20T21:32:41.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = d6a55539-1473-464e-8945-40b3fc0a512c resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
26342024-12-20T21:32:41.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = d6a55539-1473-464e-8945-40b3fc0a512c response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
26352024-12-20T21:32:41.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = b4b0f291-73af-4030-b8d3-6e06bb8f997d roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
26362024-12-20T21:32:41.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = b4b0f291-73af-4030-b8d3-6e06bb8f997d resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
26372024-12-20T21:32:41.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = b4b0f291-73af-4030-b8d3-6e06bb8f997d response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
26382024-12-20T21:32:41.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6aaf21c0-9ee0-4fa8-af83-9e320c6c8b5b roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26392024-12-20T21:32:41.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6aaf21c0-9ee0-4fa8-af83-9e320c6c8b5b resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26402024-12-20T21:32:41.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6aaf21c0-9ee0-4fa8-af83-9e320c6c8b5b response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26412024-12-20T21:32:42.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e807093c-811e-4efa-b46d-990abd2b4706 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26422024-12-20T21:32:42.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e807093c-811e-4efa-b46d-990abd2b4706 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26432024-12-20T21:32:42.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2463 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e807093c-811e-4efa-b46d-990abd2b4706 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26442024-12-20T21:32:43.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a076b755-7100-47cf-93f7-4c01dbc7102b roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26452024-12-20T21:32:43.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a076b755-7100-47cf-93f7-4c01dbc7102b resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26462024-12-20T21:32:43.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a076b755-7100-47cf-93f7-4c01dbc7102b response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26472024-12-20T21:32:44.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 605674bf-b07a-4c73-afd8-7f0e63332ef8 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26482024-12-20T21:32:44.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 605674bf-b07a-4c73-afd8-7f0e63332ef8 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26492024-12-20T21:32:44.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 605674bf-b07a-4c73-afd8-7f0e63332ef8 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26502024-12-20T21:32:45.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fcc6b8d7-fa14-4240-a1ab-0a61a7d003e8 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26512024-12-20T21:32:45.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fcc6b8d7-fa14-4240-a1ab-0a61a7d003e8 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26522024-12-20T21:32:45.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fcc6b8d7-fa14-4240-a1ab-0a61a7d003e8 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26532024-12-20T21:32:46.406ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 548 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 25545ca4-9967-4811-bbed-f6ed1ffdab4d response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
26542024-12-20T21:32:46.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8cc72238-ac4b-4fd1-a0a5-71800d9507cb roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26552024-12-20T21:32:46.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8cc72238-ac4b-4fd1-a0a5-71800d9507cb resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26562024-12-20T21:32:46.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1787 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8cc72238-ac4b-4fd1-a0a5-71800d9507cb response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26572024-12-20T21:32:47.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2bded5cf-9eaf-4d1c-aeaf-218f76dc2489 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26582024-12-20T21:32:47.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2bded5cf-9eaf-4d1c-aeaf-218f76dc2489 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26592024-12-20T21:32:47.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2471 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2bded5cf-9eaf-4d1c-aeaf-218f76dc2489 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26602024-12-20T21:32:48.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8589e814-e7b7-4612-8c2c-c1d370f10908 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26612024-12-20T21:32:48.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8589e814-e7b7-4612-8c2c-c1d370f10908 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26622024-12-20T21:32:48.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8589e814-e7b7-4612-8c2c-c1d370f10908 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
26632024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
26642024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
26652024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26662024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26672024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
26682024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26692024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
26702024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
26712024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26722024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
26732024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
26742024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
26752024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26762024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
26772024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26782024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26792024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
26802024-12-20T21:32:49.539ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
26812024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
26822024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26832024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26842024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
26852024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26862024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
26872024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26882024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
26892024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
26902024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
26912024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26922024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
26932024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
26942024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26952024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
26962024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
26972024-12-20T21:32:49.539ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26982024-12-20T21:32:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26992024-12-20T21:32:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27002024-12-20T21:32:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27012024-12-20T21:32:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27022024-12-20T21:32:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27032024-12-20T21:32:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
27042024-12-20T21:32:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27052024-12-20T21:32:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27062024-12-20T21:32:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
27072024-12-20T21:32:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27082024-12-20T21:32:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27092024-12-20T21:32:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27102024-12-20T21:32:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27112024-12-20T21:32:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27122024-12-20T21:32:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27132024-12-20T21:32:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
27142024-12-20T21:32:49.542ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27152024-12-20T21:32:49.543ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.741584ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
27162024-12-20T21:32:49.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27172024-12-20T21:32:49.544ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27182024-12-20T21:32:49.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27192024-12-20T21:32:49.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27202024-12-20T21:32:49.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27212024-12-20T21:32:49.546ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27222024-12-20T21:32:49.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27232024-12-20T21:32:49.547ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27242024-12-20T21:32:49.547ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27252024-12-20T21:32:49.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27262024-12-20T21:32:49.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27272024-12-20T21:32:49.549ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27282024-12-20T21:32:49.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27292024-12-20T21:32:49.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27302024-12-20T21:32:49.549ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27312024-12-20T21:32:49.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27322024-12-20T21:32:49.550ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27332024-12-20T21:32:49.550ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27342024-12-20T21:32:49.550ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27352024-12-20T21:32:49.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27362024-12-20T21:32:49.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27372024-12-20T21:32:49.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27382024-12-20T21:32:49.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27392024-12-20T21:32:49.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27402024-12-20T21:32:49.551ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1468, tv_nsec: 830655618 } })
27412024-12-20T21:32:49.551ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
27422024-12-20T21:32:49.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
27432024-12-20T21:32:49.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27442024-12-20T21:32:49.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27452024-12-20T21:32:49.553ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27462024-12-20T21:32:49.553ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1468, tv_nsec: 832355576 } })
27472024-12-20T21:32:49.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27482024-12-20T21:32:49.553ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
27492024-12-20T21:32:49.553ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27502024-12-20T21:32:49.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27512024-12-20T21:32:49.554ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27522024-12-20T21:32:49.554ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
27532024-12-20T21:32:49.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27542024-12-20T21:32:49.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27552024-12-20T21:32:49.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27562024-12-20T21:32:49.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27572024-12-20T21:32:49.556ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1468, tv_nsec: 835312772 } })
27582024-12-20T21:32:49.556ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
27592024-12-20T21:32:49.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27602024-12-20T21:32:49.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
27612024-12-20T21:32:49.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27622024-12-20T21:32:49.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27632024-12-20T21:32:49.575ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
27642024-12-20T21:32:49.575ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.180911ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
27652024-12-20T21:32:49.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27662024-12-20T21:32:49.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27672024-12-20T21:32:49.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 38.609016ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
27682024-12-20T21:32:49.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27692024-12-20T21:32:49.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27702024-12-20T21:32:49.581ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27712024-12-20T21:32:49.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 42.010742ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
27722024-12-20T21:32:49.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27732024-12-20T21:32:49.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27742024-12-20T21:32:49.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27752024-12-20T21:32:49.583ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27762024-12-20T21:32:49.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27772024-12-20T21:32:49.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27782024-12-20T21:32:49.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c74ff24-982c-40fd-86fd-ef04898c5922, lookup_type: ById(8c74ff24-982c-40fd-86fd-ef04898c5922) } result = Ok(())
27792024-12-20T21:32:49.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27802024-12-20T21:32:49.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27812024-12-20T21:32:49.589ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27822024-12-20T21:32:49.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27832024-12-20T21:32:49.590ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27842024-12-20T21:32:49.591ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 51.710049ms iteration = 22 status = 0
27852024-12-20T21:32:49.591ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27862024-12-20T21:32:49.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27872024-12-20T21:32:49.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27882024-12-20T21:32:49.592ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27892024-12-20T21:32:49.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27902024-12-20T21:32:49.595ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
27912024-12-20T21:32:49.595ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 55.781091ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
27922024-12-20T21:32:49.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27932024-12-20T21:32:49.596ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27942024-12-20T21:32:49.596ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
27952024-12-20T21:32:49.596ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 57.342156ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
27962024-12-20T21:32:49.597ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27972024-12-20T21:32:49.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27982024-12-20T21:32:49.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27992024-12-20T21:32:49.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 73.821226ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28002024-12-20T21:32:49.621ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 82.242654ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28012024-12-20T21:32:49.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 88.227148ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
28022024-12-20T21:32:49.628ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 89.032087ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28032024-12-20T21:32:49.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28042024-12-20T21:32:49.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28052024-12-20T21:32:49.668ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac zone_address = fd00:1122:3344:101::2
28062024-12-20T21:32:49.668ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28072024-12-20T21:32:49.668ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2849626e-a09f-40d0-91e2-3a8039522d93", "content-length": "26", "date": "Fri, 20 Dec 2024 21:32:48 GMT"} })
28082024-12-20T21:32:49.669ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28092024-12-20T21:32:49.670ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
28102024-12-20T21:32:49.673ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
28112024-12-20T21:32:49.673ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28122024-12-20T21:32:49.673ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28132024-12-20T21:32:49.673ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e89dafe-acee-4d4b-99e4-d43cc30530d8", "content-length": "26", "date": "Fri, 20 Dec 2024 21:32:48 GMT"} })
28142024-12-20T21:32:49.673ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28152024-12-20T21:32:49.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28162024-12-20T21:32:49.674ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28172024-12-20T21:32:49.675ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28182024-12-20T21:32:49.676ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28192024-12-20T21:32:49.676ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28202024-12-20T21:32:49.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28212024-12-20T21:32:49.678ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28222024-12-20T21:32:49.680ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28232024-12-20T21:32:49.680ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28242024-12-20T21:32:49.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28252024-12-20T21:32:49.696ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 157.454661ms iteration = 25 status = {"physical_disks_added":0}
28262024-12-20T21:32:49.721ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
28272024-12-20T21:32:49.721ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28282024-12-20T21:32:49.722ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ce64d3f-89e1-4c52-bb86-e95eb0d20b60", "content-length": "26", "date": "Fri, 20 Dec 2024 21:32:48 GMT"} })
28292024-12-20T21:32:49.722ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28302024-12-20T21:32:49.723ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28312024-12-20T21:32:49.787ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
28322024-12-20T21:32:49.787ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28332024-12-20T21:32:49.787ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "34b8ff6c-6b9d-4125-9d37-a69a9065efda", "content-length": "372", "date": "Fri, 20 Dec 2024 21:32:49 GMT"} })
28342024-12-20T21:32:49.787ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28352024-12-20T21:32:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28362024-12-20T21:32:49.800ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 260.88335ms iteration = 22 status = {}
28372024-12-20T21:32:49.802ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
28382024-12-20T21:32:49.802ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
28392024-12-20T21:32:49.802ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1e2740d5-809b-41e2-90cd-34477870843a", "date": "Fri, 20 Dec 2024 21:32:49 GMT"} })
28402024-12-20T21:32:49.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28412024-12-20T21:32:49.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28422024-12-20T21:32:49.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28432024-12-20T21:32:49.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28442024-12-20T21:32:49.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28452024-12-20T21:32:49.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28462024-12-20T21:32:49.811ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
28472024-12-20T21:32:49.811ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28482024-12-20T21:32:49.812ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "73465ef8-04ce-4ee2-abf9-29244a433f1e", "date": "Fri, 20 Dec 2024 21:32:49 GMT"} })
28492024-12-20T21:32:49.813ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 273.518384ms iteration = 22 status = {}
28502024-12-20T21:32:49.955ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
28512024-12-20T21:32:49.955ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c265c40-8787-4a40-a210-bb01faf3babc", "content-length": "1", "date": "Fri, 20 Dec 2024 21:32:49 GMT"} })
28522024-12-20T21:32:49.957ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
28532024-12-20T21:32:49.957ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28542024-12-20T21:32:49.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28552024-12-20T21:32:49.957ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5128fa3a-abd0-424e-9fb4-00bbd13b8bd1", "content-length": "691", "date": "Fri, 20 Dec 2024 21:32:49 GMT"} })
28562024-12-20T21:32:49.957ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
28572024-12-20T21:32:49.957ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
28582024-12-20T21:32:49.957ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
28592024-12-20T21:32:49.959ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 419.910265ms iteration = 22 status = null
28602024-12-20T21:32:49.960ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 420.757174ms iteration = 22 status = {}
28612024-12-20T21:32:49.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 45cc4a6f-73e7-47b1-92cf-3c58575ce7fb roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
28622024-12-20T21:32:49.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 45cc4a6f-73e7-47b1-92cf-3c58575ce7fb resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
28632024-12-20T21:32:49.971ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28642024-12-20T21:32:49.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 45cc4a6f-73e7-47b1-92cf-3c58575ce7fb response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
28652024-12-20T21:32:49.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28662024-12-20T21:32:49.974ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 583388f4-92af-4a10-817c-62f2e9571310, rack_id: a7e68df9-95f5-4fda-aae0-2f46483e29ac, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bacaa666-9eda-4bc8-9ccd-35df228fd476) } rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
28672024-12-20T21:32:49.974ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28682024-12-20T21:32:49.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28692024-12-20T21:32:49.985ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
28702024-12-20T21:32:49.985ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a79e1a32-2e37-44c0-8ed3-262223392c63", "content-length": "134", "date": "Fri, 20 Dec 2024 21:32:49 GMT"} })
28712024-12-20T21:32:49.986ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
28722024-12-20T21:32:49.986ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bacaa666-9eda-4bc8-9ccd-35df228fd476
28732024-12-20T21:32:49.986ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
28742024-12-20T21:32:49.986ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
28752024-12-20T21:32:49.986ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28762024-12-20T21:32:49.986ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28772024-12-20T21:32:49.986ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28782024-12-20T21:32:49.986ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28792024-12-20T21:32:49.986ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28802024-12-20T21:32:49.986ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28812024-12-20T21:32:49.986ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
28822024-12-20T21:32:49.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28832024-12-20T21:32:49.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28842024-12-20T21:32:49.989ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
28852024-12-20T21:32:49.990ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8a08fc0-3666-4369-8b04-39a3f8227fec", "content-length": "2", "date": "Fri, 20 Dec 2024 21:32:49 GMT"} })
28862024-12-20T21:32:49.990ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
28872024-12-20T21:32:49.992ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "175975e4-a006-4eb5-bfb1-187bfdacc58a", "content-length": "52", "date": "Fri, 20 Dec 2024 21:32:49 GMT"} })
28882024-12-20T21:32:49.992ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
28892024-12-20T21:32:49.992ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
28902024-12-20T21:32:50.091ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "38616fc5-968f-4f22-8737-e74bfce112f2", "date": "Fri, 20 Dec 2024 21:32:49 GMT"} })
28912024-12-20T21:32:50.091ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch = Switch0
28922024-12-20T21:32:50.091ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
28932024-12-20T21:32:50.092ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffa38e82-008b-4d8e-b9df-999b31344890", "content-length": "682", "date": "Fri, 20 Dec 2024 21:32:49 GMT"} })
28942024-12-20T21:32:50.092ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28952024-12-20T21:32:50.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28962024-12-20T21:32:50.095ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28972024-12-20T21:32:50.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28982024-12-20T21:32:50.099ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28992024-12-20T21:32:50.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29002024-12-20T21:32:50.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29012024-12-20T21:32:50.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29022024-12-20T21:32:50.109ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 569.93855ms iteration = 22 status = {}
29032024-12-20T21:32:50.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 8ba10e1f-5027-4035-8ba7-0fd5ca8c54e4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
29042024-12-20T21:32:50.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 8ba10e1f-5027-4035-8ba7-0fd5ca8c54e4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
29052024-12-20T21:32:50.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 8ba10e1f-5027-4035-8ba7-0fd5ca8c54e4 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
29062024-12-20T21:32:50.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4f183b07-ea76-43f4-973b-75054ce0e6ef roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29072024-12-20T21:32:50.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4f183b07-ea76-43f4-973b-75054ce0e6ef resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29082024-12-20T21:32:50.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4f183b07-ea76-43f4-973b-75054ce0e6ef response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29092024-12-20T21:32:52.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = be60d693-365c-46d1-be19-0c1bab843a6f roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29102024-12-20T21:32:52.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = be60d693-365c-46d1-be19-0c1bab843a6f resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29112024-12-20T21:32:52.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1869 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = be60d693-365c-46d1-be19-0c1bab843a6f response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29122024-12-20T21:32:53.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a73a82ae-e68e-45ea-8f3c-c2e928fa627a roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29132024-12-20T21:32:53.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a73a82ae-e68e-45ea-8f3c-c2e928fa627a resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29142024-12-20T21:32:53.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a73a82ae-e68e-45ea-8f3c-c2e928fa627a response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29152024-12-20T21:32:54.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 46c7be42-e0bb-40bc-8f62-efcac6fe0617 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29162024-12-20T21:32:54.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 46c7be42-e0bb-40bc-8f62-efcac6fe0617 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29172024-12-20T21:32:54.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 46c7be42-e0bb-40bc-8f62-efcac6fe0617 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29182024-12-20T21:32:55.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b0f577c4-8326-4757-9440-b240e5ad4d5b roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29192024-12-20T21:32:55.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b0f577c4-8326-4757-9440-b240e5ad4d5b resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29202024-12-20T21:32:55.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b0f577c4-8326-4757-9440-b240e5ad4d5b response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29212024-12-20T21:32:56.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4171bec7-8e82-4876-a936-922d7289d277 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29222024-12-20T21:32:56.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4171bec7-8e82-4876-a936-922d7289d277 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29232024-12-20T21:32:56.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4171bec7-8e82-4876-a936-922d7289d277 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29242024-12-20T21:32:56.406ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 538 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 384db645-5153-40e7-99b2-45129c3dda8d response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
29252024-12-20T21:32:57.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f1b17d8e-df64-47a7-b010-7ca6b2b9f020 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29262024-12-20T21:32:57.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f1b17d8e-df64-47a7-b010-7ca6b2b9f020 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29272024-12-20T21:32:57.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2584 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f1b17d8e-df64-47a7-b010-7ca6b2b9f020 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29282024-12-20T21:32:58.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = babb7abc-c865-4627-b999-f594f7493e18 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29292024-12-20T21:32:58.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = babb7abc-c865-4627-b999-f594f7493e18 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29302024-12-20T21:32:58.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = babb7abc-c865-4627-b999-f594f7493e18 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29312024-12-20T21:32:59.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cb41bf98-360a-437b-a65f-ad8447040abe roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29322024-12-20T21:32:59.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cb41bf98-360a-437b-a65f-ad8447040abe resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29332024-12-20T21:32:59.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1849 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cb41bf98-360a-437b-a65f-ad8447040abe response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29342024-12-20T21:32:59.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
29352024-12-20T21:32:59.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
29362024-12-20T21:32:59.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29372024-12-20T21:32:59.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29382024-12-20T21:32:59.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29392024-12-20T21:32:59.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29402024-12-20T21:32:59.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29412024-12-20T21:32:59.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29422024-12-20T21:32:59.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29432024-12-20T21:32:59.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29442024-12-20T21:32:59.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29452024-12-20T21:32:59.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.076962ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29462024-12-20T21:32:59.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29472024-12-20T21:32:59.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29482024-12-20T21:32:59.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29492024-12-20T21:32:59.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29502024-12-20T21:32:59.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
29512024-12-20T21:32:59.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29522024-12-20T21:32:59.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29532024-12-20T21:32:59.560ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
29542024-12-20T21:32:59.560ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.631492ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
29552024-12-20T21:33:00.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = deb6461c-f922-4abc-969e-0c282700698e roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29562024-12-20T21:33:00.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = deb6461c-f922-4abc-969e-0c282700698e resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29572024-12-20T21:33:00.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = deb6461c-f922-4abc-969e-0c282700698e response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29582024-12-20T21:33:01.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0416bfbc-eb45-41ac-8e70-9e0fc85723aa roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29592024-12-20T21:33:01.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0416bfbc-eb45-41ac-8e70-9e0fc85723aa resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29602024-12-20T21:33:01.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0416bfbc-eb45-41ac-8e70-9e0fc85723aa response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29612024-12-20T21:33:02.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9c85d4f6-7082-45fa-990e-47785f4941f6 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29622024-12-20T21:33:02.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9c85d4f6-7082-45fa-990e-47785f4941f6 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29632024-12-20T21:33:02.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9c85d4f6-7082-45fa-990e-47785f4941f6 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29642024-12-20T21:33:03.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b17050b0-2e9d-40a3-a4b3-66165041531d roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29652024-12-20T21:33:03.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b17050b0-2e9d-40a3-a4b3-66165041531d resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29662024-12-20T21:33:03.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2601 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b17050b0-2e9d-40a3-a4b3-66165041531d response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29672024-12-20T21:33:04.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3d9e0ede-c7bf-4ab7-8cb1-dd9012e8e196 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29682024-12-20T21:33:04.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3d9e0ede-c7bf-4ab7-8cb1-dd9012e8e196 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29692024-12-20T21:33:04.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1902 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3d9e0ede-c7bf-4ab7-8cb1-dd9012e8e196 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29702024-12-20T21:33:05.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e8b53745-df14-47c1-8336-97e51a59fb3a roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29712024-12-20T21:33:05.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e8b53745-df14-47c1-8336-97e51a59fb3a resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29722024-12-20T21:33:05.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2539 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e8b53745-df14-47c1-8336-97e51a59fb3a response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29732024-12-20T21:33:06.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 16001725-b4ed-4598-bbcc-cf6244aa4af9 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29742024-12-20T21:33:06.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 16001725-b4ed-4598-bbcc-cf6244aa4af9 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29752024-12-20T21:33:06.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1922 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 16001725-b4ed-4598-bbcc-cf6244aa4af9 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29762024-12-20T21:33:06.406ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 622 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 911eb0ad-d4ab-48fd-a989-a5ae22fb5f1f response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
29772024-12-20T21:33:07.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fbff107f-9067-46e1-87af-77b0068c64c5 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29782024-12-20T21:33:07.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fbff107f-9067-46e1-87af-77b0068c64c5 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29792024-12-20T21:33:07.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fbff107f-9067-46e1-87af-77b0068c64c5 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29802024-12-20T21:33:08.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 39b7b4b5-4b28-439b-8d7c-d20c2372ac2d roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29812024-12-20T21:33:08.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 39b7b4b5-4b28-439b-8d7c-d20c2372ac2d resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29822024-12-20T21:33:08.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 39b7b4b5-4b28-439b-8d7c-d20c2372ac2d response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29832024-12-20T21:33:09.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4b9b4199-00e0-4a46-9530-b4e3154efbd9 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29842024-12-20T21:33:09.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4b9b4199-00e0-4a46-9530-b4e3154efbd9 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29852024-12-20T21:33:09.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4b9b4199-00e0-4a46-9530-b4e3154efbd9 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
29862024-12-20T21:33:09.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
29872024-12-20T21:33:09.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
29882024-12-20T21:33:09.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29892024-12-20T21:33:09.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29902024-12-20T21:33:09.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29912024-12-20T21:33:09.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29922024-12-20T21:33:09.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29932024-12-20T21:33:09.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29942024-12-20T21:33:09.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29952024-12-20T21:33:09.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29962024-12-20T21:33:09.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29972024-12-20T21:33:09.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29982024-12-20T21:33:09.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.769237ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29992024-12-20T21:33:09.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30002024-12-20T21:33:09.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30012024-12-20T21:33:09.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30022024-12-20T21:33:09.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
30032024-12-20T21:33:09.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30042024-12-20T21:33:09.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30052024-12-20T21:33:09.559ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
30062024-12-20T21:33:09.559ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.536988ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
30072024-12-20T21:33:10.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f20e1b84-91ee-49bb-9850-cb1a85839dea roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30082024-12-20T21:33:10.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f20e1b84-91ee-49bb-9850-cb1a85839dea resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30092024-12-20T21:33:10.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f20e1b84-91ee-49bb-9850-cb1a85839dea response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30102024-12-20T21:33:11.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = aba2661e-b193-4807-b854-611ac7a65540 roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
30112024-12-20T21:33:11.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = aba2661e-b193-4807-b854-611ac7a65540 resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
30122024-12-20T21:33:11.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = aba2661e-b193-4807-b854-611ac7a65540 response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
30132024-12-20T21:33:11.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = 390a8b33-4c69-4605-8cbe-befa71d7e4b5 roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
30142024-12-20T21:33:11.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = 390a8b33-4c69-4605-8cbe-befa71d7e4b5 resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
30152024-12-20T21:33:11.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = 390a8b33-4c69-4605-8cbe-befa71d7e4b5 response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
30162024-12-20T21:33:11.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ee8a9b62-0efd-4766-a55c-e78f97797309 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30172024-12-20T21:33:11.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ee8a9b62-0efd-4766-a55c-e78f97797309 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30182024-12-20T21:33:11.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2016 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ee8a9b62-0efd-4766-a55c-e78f97797309 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30192024-12-20T21:33:12.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2c1a6e74-bec9-4e32-88de-f8f0a4771d21 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30202024-12-20T21:33:12.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2c1a6e74-bec9-4e32-88de-f8f0a4771d21 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30212024-12-20T21:33:12.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2c1a6e74-bec9-4e32-88de-f8f0a4771d21 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30222024-12-20T21:33:13.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0099fc68-0219-4967-8dde-66516d18b473 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30232024-12-20T21:33:13.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0099fc68-0219-4967-8dde-66516d18b473 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30242024-12-20T21:33:13.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0099fc68-0219-4967-8dde-66516d18b473 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30252024-12-20T21:33:14.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9729f369-22e6-4447-8e27-d9b3931366c6 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30262024-12-20T21:33:14.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9729f369-22e6-4447-8e27-d9b3931366c6 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30272024-12-20T21:33:14.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9729f369-22e6-4447-8e27-d9b3931366c6 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30282024-12-20T21:33:15.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 85f72091-52fc-4e58-84c1-627e7d268a34 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30292024-12-20T21:33:15.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 85f72091-52fc-4e58-84c1-627e7d268a34 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30302024-12-20T21:33:15.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 85f72091-52fc-4e58-84c1-627e7d268a34 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30312024-12-20T21:33:16.406ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 644 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 3944a74d-1d34-4b43-9ce1-b68e63ee08d9 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
30322024-12-20T21:33:16.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 264451b8-8bb8-4140-8982-f70ea288bca0 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30332024-12-20T21:33:16.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 264451b8-8bb8-4140-8982-f70ea288bca0 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30342024-12-20T21:33:16.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1626 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 264451b8-8bb8-4140-8982-f70ea288bca0 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30352024-12-20T21:33:17.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d89d1c84-1497-4285-84b8-44fc5566ea67 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30362024-12-20T21:33:17.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d89d1c84-1497-4285-84b8-44fc5566ea67 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30372024-12-20T21:33:17.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d89d1c84-1497-4285-84b8-44fc5566ea67 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30382024-12-20T21:33:18.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2abcb2a2-d51f-46d8-8a4b-6038470772c0 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30392024-12-20T21:33:18.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2abcb2a2-d51f-46d8-8a4b-6038470772c0 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30402024-12-20T21:33:18.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2549 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2abcb2a2-d51f-46d8-8a4b-6038470772c0 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
30412024-12-20T21:33:19.539ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
30422024-12-20T21:33:19.539ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
30432024-12-20T21:33:19.539ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
30442024-12-20T21:33:19.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30452024-12-20T21:33:19.539ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
30462024-12-20T21:33:19.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
30472024-12-20T21:33:19.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
30482024-12-20T21:33:19.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30492024-12-20T21:33:19.539ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
30502024-12-20T21:33:19.539ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
30512024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
30522024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30532024-12-20T21:33:19.540ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9112287e-7109-46ca-aa8a-610048d83c82
30542024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.91\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"9112287e-7109-46ca-aa8a-610048d83c82"}
30552024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
30562024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
30572024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
30582024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
30592024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
30602024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
30612024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
30622024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
30632024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30642024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
30652024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
30662024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30672024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
30682024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
30692024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30702024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30712024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
30722024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
30732024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30742024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
30752024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30762024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
30772024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30782024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
30792024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30802024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
30812024-12-20T21:33:19.540ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
30822024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30832024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
30842024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
30852024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30862024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30872024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
30882024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
30892024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
30902024-12-20T21:33:19.540ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 21:23:19.540212422 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
30912024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
30922024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
30932024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30942024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
30952024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
30962024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
30972024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
30982024-12-20T21:33:19.540ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
30992024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31002024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
31012024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
31022024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31032024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
31042024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31052024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31062024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31072024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
31082024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
31092024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31102024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31112024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31122024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31132024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31142024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31152024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
31162024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
31172024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31182024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31192024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31202024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
31212024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31222024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31232024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31242024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31252024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31262024-12-20T21:33:19.540ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4565f09e-ee63-469d-bb6e-3ccd4abd01fe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("73abfaca-4f35-4f97-9980-1890d6dba8fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3f6b067-d10e-44b3-9f21-f8e5a96a2b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3f6b067-d10e-44b3-9f21-f8e5a96a2b37.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1498, tv_nsec: 819941057 } })
31272024-12-20T21:33:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
31282024-12-20T21:33:19.540ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("065cea45-0eca-4287-90a0-2c3c20ec32f8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b24cb173-c3a3-4237-abe6-0e7953a415e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b24cb173-c3a3-4237-abe6-0e7953a415e5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1498, tv_nsec: 820021799 } })
31292024-12-20T21:33:19.541ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
31302024-12-20T21:33:19.541ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
31312024-12-20T21:33:19.541ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.567645ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
31322024-12-20T21:33:19.541ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.456343ms iteration = 12 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
31332024-12-20T21:33:19.542ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1498, tv_nsec: 821957652 } })
31342024-12-20T21:33:19.543ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
31352024-12-20T21:33:19.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31362024-12-20T21:33:19.544ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.164793ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
31372024-12-20T21:33:19.544ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31382024-12-20T21:33:19.544ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
31392024-12-20T21:33:19.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31402024-12-20T21:33:19.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31412024-12-20T21:33:19.544ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31422024-12-20T21:33:19.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
31432024-12-20T21:33:19.545ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31442024-12-20T21:33:19.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31452024-12-20T21:33:19.547ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31462024-12-20T21:33:19.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31472024-12-20T21:33:19.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
31482024-12-20T21:33:19.548ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31492024-12-20T21:33:19.548ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31502024-12-20T21:33:19.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31512024-12-20T21:33:19.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31522024-12-20T21:33:19.548ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31532024-12-20T21:33:19.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31542024-12-20T21:33:19.550ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1498, tv_nsec: 829881489 } })
31552024-12-20T21:33:19.551ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
31562024-12-20T21:33:19.551ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 21:23:19.540212422 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
31572024-12-20T21:33:19.551ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.939116ms iteration = 12 status = {"expiration":"2024-12-20T21:23:19.540212422Z","pruned":[]}
31582024-12-20T21:33:19.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31592024-12-20T21:33:19.553ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31602024-12-20T21:33:19.553ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31612024-12-20T21:33:19.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31622024-12-20T21:33:19.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31632024-12-20T21:33:19.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31642024-12-20T21:33:19.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31652024-12-20T21:33:19.556ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31662024-12-20T21:33:19.556ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31672024-12-20T21:33:19.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31682024-12-20T21:33:19.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31692024-12-20T21:33:19.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31702024-12-20T21:33:19.558ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31712024-12-20T21:33:19.558ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.246319ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
31722024-12-20T21:33:19.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
31732024-12-20T21:33:19.560ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
31742024-12-20T21:33:19.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31752024-12-20T21:33:19.560ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31762024-12-20T21:33:19.560ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
31772024-12-20T21:33:19.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31782024-12-20T21:33:19.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31792024-12-20T21:33:19.562ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31802024-12-20T21:33:19.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31812024-12-20T21:33:19.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31822024-12-20T21:33:19.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31832024-12-20T21:33:19.563ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31842024-12-20T21:33:19.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31852024-12-20T21:33:19.564ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31862024-12-20T21:33:19.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31872024-12-20T21:33:19.566ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31882024-12-20T21:33:19.566ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31892024-12-20T21:33:19.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31902024-12-20T21:33:19.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31912024-12-20T21:33:19.573ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 33.634834ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
31922024-12-20T21:33:19.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31932024-12-20T21:33:19.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
31942024-12-20T21:33:19.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31952024-12-20T21:33:19.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31962024-12-20T21:33:19.596ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.369934ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
31972024-12-20T21:33:19.596ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31982024-12-20T21:33:19.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31992024-12-20T21:33:19.599ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32002024-12-20T21:33:19.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32012024-12-20T21:33:19.601ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32022024-12-20T21:33:19.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32032024-12-20T21:33:19.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32042024-12-20T21:33:19.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32052024-12-20T21:33:19.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32062024-12-20T21:33:19.604ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32072024-12-20T21:33:19.604ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32082024-12-20T21:33:19.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32092024-12-20T21:33:19.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32102024-12-20T21:33:19.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32112024-12-20T21:33:19.608ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32122024-12-20T21:33:19.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32132024-12-20T21:33:19.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32142024-12-20T21:33:19.609ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
32152024-12-20T21:33:19.609ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
32162024-12-20T21:33:19.609ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.479808ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
32172024-12-20T21:33:19.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32182024-12-20T21:33:19.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d4de1a95-75c3-454d-8518-e4117fecfdce roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
32192024-12-20T21:33:19.612ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
32202024-12-20T21:33:19.612ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
32212024-12-20T21:33:19.612ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
32222024-12-20T21:33:19.612ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32232024-12-20T21:33:19.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d4de1a95-75c3-454d-8518-e4117fecfdce resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
32242024-12-20T21:33:19.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32252024-12-20T21:33:19.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
32262024-12-20T21:33:19.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32272024-12-20T21:33:19.612ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32282024-12-20T21:33:19.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32292024-12-20T21:33:19.612ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
32302024-12-20T21:33:19.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32312024-12-20T21:33:19.612ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.842713ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
32322024-12-20T21:33:19.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32332024-12-20T21:33:19.613ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
32342024-12-20T21:33:19.613ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
32352024-12-20T21:33:19.613ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 73.471538ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
32362024-12-20T21:33:19.614ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32372024-12-20T21:33:19.614ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
32382024-12-20T21:33:19.614ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 74.267416ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
32392024-12-20T21:33:19.625ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
32402024-12-20T21:33:19.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32412024-12-20T21:33:19.641ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
32422024-12-20T21:33:19.641ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
32432024-12-20T21:33:19.641ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
32442024-12-20T21:33:19.641ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32452024-12-20T21:33:19.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32462024-12-20T21:33:19.641ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 101.702061ms iteration = 26 status = {"physical_disks_added":0}
32472024-12-20T21:33:19.661ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32482024-12-20T21:33:19.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32492024-12-20T21:33:19.666ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
32502024-12-20T21:33:19.692ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
32512024-12-20T21:33:19.692ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32522024-12-20T21:33:19.692ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3c2cda5-f881-4bc2-a0e9-96c577286f12", "content-length": "26", "date": "Fri, 20 Dec 2024 21:33:18 GMT"} })
32532024-12-20T21:33:19.692ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32542024-12-20T21:33:19.694ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32552024-12-20T21:33:19.807ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
32562024-12-20T21:33:19.807ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "23decf06-6873-4851-b65c-c449f7c31877", "date": "Fri, 20 Dec 2024 21:33:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
32572024-12-20T21:33:19.807ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
32582024-12-20T21:33:19.809ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9d44ad50-19be-448e-b68d-304d07fc5c31", "date": "Fri, 20 Dec 2024 21:33:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
32592024-12-20T21:33:19.809ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
32602024-12-20T21:33:19.810ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
32612024-12-20T21:33:19.810ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 270.600868ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
32622024-12-20T21:33:19.821ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
32632024-12-20T21:33:19.836ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
32642024-12-20T21:33:19.836ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d96fa090-5c24-4d95-98c3-1363d1ee9e57", "content-length": "1", "date": "Fri, 20 Dec 2024 21:33:19 GMT"} })
32652024-12-20T21:33:19.838ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32662024-12-20T21:33:19.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32672024-12-20T21:33:19.905ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
32682024-12-20T21:33:19.905ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32692024-12-20T21:33:19.906ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "af96b86c-28fd-4354-afb6-c82791105a3e", "content-length": "26", "date": "Fri, 20 Dec 2024 21:33:19 GMT"} })
32702024-12-20T21:33:19.906ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32712024-12-20T21:33:19.908ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32722024-12-20T21:33:19.955ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
32732024-12-20T21:33:19.955ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32742024-12-20T21:33:19.955ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "433ce9d5-1772-47fd-988c-38a39c56ac8f", "content-length": "372", "date": "Fri, 20 Dec 2024 21:33:19 GMT"} })
32752024-12-20T21:33:19.955ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32762024-12-20T21:33:19.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32772024-12-20T21:33:19.957ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 416.677773ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32782024-12-20T21:33:19.968ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1499, tv_nsec: 247634196 } })
32792024-12-20T21:33:19.968ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
32802024-12-20T21:33:19.970ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32812024-12-20T21:33:19.970ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32822024-12-20T21:33:19.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 358259 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d4de1a95-75c3-454d-8518-e4117fecfdce response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
32832024-12-20T21:33:19.970ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 430.473212ms iteration = 23 status = null
32842024-12-20T21:33:19.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32852024-12-20T21:33:19.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32862024-12-20T21:33:19.972ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32872024-12-20T21:33:19.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
32882024-12-20T21:33:19.975ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32892024-12-20T21:33:19.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32902024-12-20T21:33:19.980ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
32912024-12-20T21:33:19.984ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
32922024-12-20T21:33:19.984ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 444.279832ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
32932024-12-20T21:33:20.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32942024-12-20T21:33:20.011ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 471.584634ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32952024-12-20T21:33:20.011ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 471.683086ms iteration = 23 status = {}
32962024-12-20T21:33:20.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32972024-12-20T21:33:20.014ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32982024-12-20T21:33:20.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32992024-12-20T21:33:20.015ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33002024-12-20T21:33:20.017ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 477.324432ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
33012024-12-20T21:33:20.017ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33022024-12-20T21:33:20.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33032024-12-20T21:33:20.018ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 478.726674ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
33042024-12-20T21:33:20.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33052024-12-20T21:33:20.020ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33062024-12-20T21:33:20.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33072024-12-20T21:33:20.021ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33082024-12-20T21:33:20.023ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33092024-12-20T21:33:20.023ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33102024-12-20T21:33:20.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33112024-12-20T21:33:20.024ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33122024-12-20T21:33:20.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c74ff24-982c-40fd-86fd-ef04898c5922, lookup_type: ById(8c74ff24-982c-40fd-86fd-ef04898c5922) } result = Ok(())
33132024-12-20T21:33:20.027ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33142024-12-20T21:33:20.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33152024-12-20T21:33:20.029ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 489.739311ms iteration = 23 status = 0
33162024-12-20T21:33:20.041ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
33172024-12-20T21:33:20.041ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
33182024-12-20T21:33:20.042ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1859b2db-339d-4dd1-ac95-c9a068feee6b", "date": "Fri, 20 Dec 2024 21:33:19 GMT"} })
33192024-12-20T21:33:20.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33202024-12-20T21:33:20.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33212024-12-20T21:33:20.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33222024-12-20T21:33:20.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33232024-12-20T21:33:20.049ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33242024-12-20T21:33:20.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33252024-12-20T21:33:20.049ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
33262024-12-20T21:33:20.049ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4aec9cd8-ad86-40dc-bdd7-2394e3237b38 dns_zone_name = oxide.test found_so_far = 0 version = 2
33272024-12-20T21:33:20.049ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33282024-12-20T21:33:20.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33292024-12-20T21:33:20.052ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
33302024-12-20T21:33:20.052ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33312024-12-20T21:33:20.053ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "538d9154-b59a-4257-965a-1d1b6869cf91", "date": "Fri, 20 Dec 2024 21:33:19 GMT"} })
33322024-12-20T21:33:20.054ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 514.737902ms iteration = 23 status = {}
33332024-12-20T21:33:20.055ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac zone_address = fd00:1122:3344:101::2
33342024-12-20T21:33:20.055ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33352024-12-20T21:33:20.055ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "edf69654-d9c1-4dbb-b48f-ab46451ec13e", "content-length": "26", "date": "Fri, 20 Dec 2024 21:33:19 GMT"} })
33362024-12-20T21:33:20.055ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33372024-12-20T21:33:20.056ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
33382024-12-20T21:33:20.056ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c58feff7-51f2-445e-83fd-a0c3a102f4ed dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
33392024-12-20T21:33:20.056ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33402024-12-20T21:33:20.056ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T21:22:10.640928Z, time_modified: 2024-12-20T21:22:10.640928Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, db_silo: Silo { identity: SiloIdentity { id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T21:23:05.471312Z, time_modified: 2024-12-20T21:23:05.471312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, db_silo: Silo { identity: SiloIdentity { id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T21:23:05.471312Z, time_modified: 2024-12-20T21:23:05.471312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b" }] }) }
33412024-12-20T21:33:20.056ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 516.360478ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"66e8bce1-b95a-4433-886f-e35fda6d9a14","tls_certs":["4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b"]}},"default_endpoint":{"silo_id":"66e8bce1-b95a-4433-886f-e35fda6d9a14","tls_certs":["4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
33422024-12-20T21:33:20.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33432024-12-20T21:33:20.057ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
33442024-12-20T21:33:20.057ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33452024-12-20T21:33:20.057ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
33462024-12-20T21:33:20.057ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "89721a91-abd0-4238-ab53-09ff64186084", "date": "Fri, 20 Dec 2024 21:33:20 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
33472024-12-20T21:33:20.058ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
33482024-12-20T21:33:20.059ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d1fd23f8-69af-4be4-9f4d-387056dcc42f", "date": "Fri, 20 Dec 2024 21:33:20 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
33492024-12-20T21:33:20.059ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
33502024-12-20T21:33:20.060ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "98215d06-b16d-4291-a503-409c2643a71e", "date": "Fri, 20 Dec 2024 21:33:20 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
33512024-12-20T21:33:20.060ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
33522024-12-20T21:33:20.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33532024-12-20T21:33:20.060ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33542024-12-20T21:33:20.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33552024-12-20T21:33:20.062ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
33562024-12-20T21:33:20.062ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 522.569897ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
33572024-12-20T21:33:20.063ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c58feff7-51f2-445e-83fd-a0c3a102f4ed dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
33582024-12-20T21:33:20.063ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
33592024-12-20T21:33:20.063ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 21:23:04.517297 UTC dns_group = internal generation = 1
33602024-12-20T21:33:20.063ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 523.395036ms iteration = 12 status = {"generation":1}
33612024-12-20T21:33:20.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33622024-12-20T21:33:20.088ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
33632024-12-20T21:33:20.088ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 548.12759ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
33642024-12-20T21:33:20.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33652024-12-20T21:33:20.088ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33662024-12-20T21:33:20.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33672024-12-20T21:33:20.091ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4aec9cd8-ad86-40dc-bdd7-2394e3237b38 dns_zone_name = oxide.test found_so_far = 1 version = 2
33682024-12-20T21:33:20.091ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
33692024-12-20T21:33:20.091ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 21:23:05.526309 UTC dns_group = external generation = 2
33702024-12-20T21:33:20.091ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 551.107957ms iteration = 12 status = {"generation":2}
33712024-12-20T21:33:20.096ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33722024-12-20T21:33:20.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33732024-12-20T21:33:20.097ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33742024-12-20T21:33:20.099ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33752024-12-20T21:33:20.099ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33762024-12-20T21:33:20.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33772024-12-20T21:33:20.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33782024-12-20T21:33:20.102ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33792024-12-20T21:33:20.102ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33802024-12-20T21:33:20.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33812024-12-20T21:33:20.153ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33822024-12-20T21:33:20.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33832024-12-20T21:33:20.156ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 583388f4-92af-4a10-817c-62f2e9571310, rack_id: a7e68df9-95f5-4fda-aae0-2f46483e29ac, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bacaa666-9eda-4bc8-9ccd-35df228fd476) } rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
33842024-12-20T21:33:20.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33852024-12-20T21:33:20.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33862024-12-20T21:33:20.170ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
33872024-12-20T21:33:20.171ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bd31778-5b84-416b-ac9c-b05513828c7f", "content-length": "134", "date": "Fri, 20 Dec 2024 21:33:19 GMT"} })
33882024-12-20T21:33:20.171ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
33892024-12-20T21:33:20.171ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bacaa666-9eda-4bc8-9ccd-35df228fd476
33902024-12-20T21:33:20.171ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
33912024-12-20T21:33:20.171ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33922024-12-20T21:33:20.171ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33932024-12-20T21:33:20.171ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33942024-12-20T21:33:20.171ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33952024-12-20T21:33:20.171ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33962024-12-20T21:33:20.171ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33972024-12-20T21:33:20.171ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33982024-12-20T21:33:20.172ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
33992024-12-20T21:33:20.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34002024-12-20T21:33:20.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34012024-12-20T21:33:20.174ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
34022024-12-20T21:33:20.174ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "13568dd7-f213-4eed-9033-a48270662f28", "content-length": "2", "date": "Fri, 20 Dec 2024 21:33:19 GMT"} })
34032024-12-20T21:33:20.174ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
34042024-12-20T21:33:20.174ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3405ca55-a9dd-4e05-bda7-c59675ca5870", "content-length": "52", "date": "Fri, 20 Dec 2024 21:33:19 GMT"} })
34052024-12-20T21:33:20.174ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
34062024-12-20T21:33:20.174ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
34072024-12-20T21:33:20.202ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
34082024-12-20T21:33:20.205ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
34092024-12-20T21:33:20.205ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
34102024-12-20T21:33:20.253ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
34112024-12-20T21:33:20.253ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:61010
34122024-12-20T21:33:20.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61010 req_id = 9952ff76-c179-4d8f-b00a-57f2d4063969 roles = RoleSet { roles: {} } uri = /metrics/producers
34132024-12-20T21:33:20.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61010 req_id = 9952ff76-c179-4d8f-b00a-57f2d4063969 resource = Database result = Ok(()) uri = /metrics/producers
34142024-12-20T21:33:20.316ZINFOnexus: assigned collector to new producer collector_id = f413b9dc-12d9-42dc-9e49-cb25b63f7e80 file = nexus/src/app/oximeter.rs:76 producer_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
34152024-12-20T21:33:20.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62757 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61010 req_id = 9952ff76-c179-4d8f-b00a-57f2d4063969 response_code = 201 uri = /metrics/producers
34162024-12-20T21:33:20.316ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "9952ff76-c179-4d8f-b00a-57f2d4063969", "content-length": "41", "date": "Fri, 20 Dec 2024 21:33:20 GMT"} })
34172024-12-20T21:33:20.317ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "728affad-e92b-4100-83bd-255e7cf64db4", "date": "Fri, 20 Dec 2024 21:33:19 GMT"} })
34182024-12-20T21:33:20.317ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch = Switch0
34192024-12-20T21:33:20.317ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
34202024-12-20T21:33:20.318ZDEBGnexus (producer-registration-task): registered with nexus successfully
34212024-12-20T21:33:20.318ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
34222024-12-20T21:33:20.318ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "afa38a3e-0efc-4183-92b8-842f6b6219a9", "content-length": "682", "date": "Fri, 20 Dec 2024 21:33:20 GMT"} })
34232024-12-20T21:33:20.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34242024-12-20T21:33:20.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34252024-12-20T21:33:20.318ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "962a92de-f2bf-4268-a0d4-88fba939d1dd", "content-length": "691", "date": "Fri, 20 Dec 2024 21:33:20 GMT"} })
34262024-12-20T21:33:20.318ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
34272024-12-20T21:33:20.318ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
34282024-12-20T21:33:20.318ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
34292024-12-20T21:33:20.320ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 780.634464ms iteration = 23 status = {}
34302024-12-20T21:33:20.323ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34312024-12-20T21:33:20.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34322024-12-20T21:33:20.327ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34332024-12-20T21:33:20.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34342024-12-20T21:33:20.329ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34352024-12-20T21:33:20.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34362024-12-20T21:33:20.338ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 798.038254ms iteration = 23 status = {}
34372024-12-20T21:33:20.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 07328597-e1c6-43c0-b0c7-8f755127fb91 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
34382024-12-20T21:33:20.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 07328597-e1c6-43c0-b0c7-8f755127fb91 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
34392024-12-20T21:33:20.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3706 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 07328597-e1c6-43c0-b0c7-8f755127fb91 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
34402024-12-20T21:33:20.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d1fd2af6-fe92-4fa9-b1ac-8ebdc95b7ad5 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34412024-12-20T21:33:20.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d1fd2af6-fe92-4fa9-b1ac-8ebdc95b7ad5 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34422024-12-20T21:33:20.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2733 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d1fd2af6-fe92-4fa9-b1ac-8ebdc95b7ad5 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34432024-12-20T21:33:22.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 96bb46bf-dd5b-44d3-b0d4-c791dedff9d5 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34442024-12-20T21:33:22.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 96bb46bf-dd5b-44d3-b0d4-c791dedff9d5 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34452024-12-20T21:33:22.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 96bb46bf-dd5b-44d3-b0d4-c791dedff9d5 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34462024-12-20T21:33:23.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 960b43ed-9c4e-410c-9f89-dea4d3a39387 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34472024-12-20T21:33:23.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 960b43ed-9c4e-410c-9f89-dea4d3a39387 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34482024-12-20T21:33:23.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 960b43ed-9c4e-410c-9f89-dea4d3a39387 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34492024-12-20T21:33:24.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 37fe8188-5359-4096-9f5a-5d3cdbbe59a1 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34502024-12-20T21:33:24.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 37fe8188-5359-4096-9f5a-5d3cdbbe59a1 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34512024-12-20T21:33:24.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 37fe8188-5359-4096-9f5a-5d3cdbbe59a1 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34522024-12-20T21:33:25.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4a9de2c5-2d6e-4e43-98a8-ddba138484f3 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34532024-12-20T21:33:25.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4a9de2c5-2d6e-4e43-98a8-ddba138484f3 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34542024-12-20T21:33:25.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4a9de2c5-2d6e-4e43-98a8-ddba138484f3 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34552024-12-20T21:33:26.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cbf4a8dc-b461-4034-8486-afb5e7a77d1e roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34562024-12-20T21:33:26.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cbf4a8dc-b461-4034-8486-afb5e7a77d1e resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34572024-12-20T21:33:26.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cbf4a8dc-b461-4034-8486-afb5e7a77d1e response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34582024-12-20T21:33:26.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = cdbf7ae1-946a-4ba6-b246-e32c1cde12bd roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
34592024-12-20T21:33:26.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = cdbf7ae1-946a-4ba6-b246-e32c1cde12bd resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
34602024-12-20T21:33:26.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = cdbf7ae1-946a-4ba6-b246-e32c1cde12bd response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
34612024-12-20T21:33:26.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = 26ca6458-5bc7-4a03-ab26-983fc5895841 roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
34622024-12-20T21:33:26.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = 26ca6458-5bc7-4a03-ab26-983fc5895841 resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
34632024-12-20T21:33:26.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = 26ca6458-5bc7-4a03-ab26-983fc5895841 response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
34642024-12-20T21:33:26.406ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 530 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = e7015296-4f9a-419b-9857-b447e4a1ab3b response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
34652024-12-20T21:33:27.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f535b001-8780-4030-b1ad-afb2d227fa68 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34662024-12-20T21:33:27.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f535b001-8780-4030-b1ad-afb2d227fa68 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34672024-12-20T21:33:27.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2463 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f535b001-8780-4030-b1ad-afb2d227fa68 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34682024-12-20T21:33:28.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a11025c9-5b91-48cc-ae97-313ed6a210de roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34692024-12-20T21:33:28.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a11025c9-5b91-48cc-ae97-313ed6a210de resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34702024-12-20T21:33:28.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a11025c9-5b91-48cc-ae97-313ed6a210de response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34712024-12-20T21:33:29.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7ee564ad-fa4a-4317-8bed-eacff9a231c8 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34722024-12-20T21:33:29.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7ee564ad-fa4a-4317-8bed-eacff9a231c8 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34732024-12-20T21:33:29.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7ee564ad-fa4a-4317-8bed-eacff9a231c8 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34742024-12-20T21:33:29.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
34752024-12-20T21:33:29.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34762024-12-20T21:33:29.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
34772024-12-20T21:33:29.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34782024-12-20T21:33:29.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34792024-12-20T21:33:29.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34802024-12-20T21:33:29.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34812024-12-20T21:33:29.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34822024-12-20T21:33:29.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34832024-12-20T21:33:29.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34842024-12-20T21:33:29.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34852024-12-20T21:33:29.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34862024-12-20T21:33:29.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34872024-12-20T21:33:29.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
34882024-12-20T21:33:29.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34892024-12-20T21:33:29.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34902024-12-20T21:33:29.562ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
34912024-12-20T21:33:29.562ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.848243ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
34922024-12-20T21:33:29.570ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34932024-12-20T21:33:29.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34942024-12-20T21:33:29.598ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.826649ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34952024-12-20T21:33:30.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ff9ef5d9-f1fb-4693-b1c8-7625bc037909 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34962024-12-20T21:33:30.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ff9ef5d9-f1fb-4693-b1c8-7625bc037909 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34972024-12-20T21:33:30.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1778 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ff9ef5d9-f1fb-4693-b1c8-7625bc037909 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34982024-12-20T21:33:31.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d4f36327-eb5c-4d5a-8625-e0a3e7bcfbef roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
34992024-12-20T21:33:31.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d4f36327-eb5c-4d5a-8625-e0a3e7bcfbef resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35002024-12-20T21:33:31.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d4f36327-eb5c-4d5a-8625-e0a3e7bcfbef response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35012024-12-20T21:33:32.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 16fcf967-ab1b-44d6-9eb1-a58ee5365ff7 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35022024-12-20T21:33:32.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 16fcf967-ab1b-44d6-9eb1-a58ee5365ff7 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35032024-12-20T21:33:32.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 16fcf967-ab1b-44d6-9eb1-a58ee5365ff7 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35042024-12-20T21:33:33.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b685e0fe-8316-43c8-9b3d-8fa50c913877 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35052024-12-20T21:33:33.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b685e0fe-8316-43c8-9b3d-8fa50c913877 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35062024-12-20T21:33:33.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b685e0fe-8316-43c8-9b3d-8fa50c913877 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35072024-12-20T21:33:34.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b73be711-66c2-4e92-8009-529afbeb9659 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35082024-12-20T21:33:34.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b73be711-66c2-4e92-8009-529afbeb9659 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35092024-12-20T21:33:34.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b73be711-66c2-4e92-8009-529afbeb9659 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35102024-12-20T21:33:35.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5a83f139-fef1-463c-b104-3afa981d37fd roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35112024-12-20T21:33:35.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5a83f139-fef1-463c-b104-3afa981d37fd resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35122024-12-20T21:33:35.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1559 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5a83f139-fef1-463c-b104-3afa981d37fd response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35132024-12-20T21:33:36.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d6e1e571-773e-4990-b8b5-4150ac6e2ed2 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35142024-12-20T21:33:36.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d6e1e571-773e-4990-b8b5-4150ac6e2ed2 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35152024-12-20T21:33:36.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d6e1e571-773e-4990-b8b5-4150ac6e2ed2 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35162024-12-20T21:33:36.406ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 619 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 19b7490b-864b-4470-8468-f53c706bbd53 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
35172024-12-20T21:33:37.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e4b6f416-7d48-4c53-8417-0a378db4f9db roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35182024-12-20T21:33:37.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e4b6f416-7d48-4c53-8417-0a378db4f9db resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35192024-12-20T21:33:37.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e4b6f416-7d48-4c53-8417-0a378db4f9db response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35202024-12-20T21:33:38.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cc0ba90b-6ab0-4dea-bba6-9d6cde8ac202 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35212024-12-20T21:33:38.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cc0ba90b-6ab0-4dea-bba6-9d6cde8ac202 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35222024-12-20T21:33:38.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2566 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cc0ba90b-6ab0-4dea-bba6-9d6cde8ac202 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35232024-12-20T21:33:39.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 76e4c711-50ed-43ec-ba69-ea98dd0243c7 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35242024-12-20T21:33:39.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 76e4c711-50ed-43ec-ba69-ea98dd0243c7 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35252024-12-20T21:33:39.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 76e4c711-50ed-43ec-ba69-ea98dd0243c7 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35262024-12-20T21:33:39.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
35272024-12-20T21:33:39.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
35282024-12-20T21:33:39.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35292024-12-20T21:33:39.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35302024-12-20T21:33:39.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35312024-12-20T21:33:39.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35322024-12-20T21:33:39.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35332024-12-20T21:33:39.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35342024-12-20T21:33:39.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35352024-12-20T21:33:39.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35362024-12-20T21:33:39.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35372024-12-20T21:33:39.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35382024-12-20T21:33:39.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35392024-12-20T21:33:39.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
35402024-12-20T21:33:39.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35412024-12-20T21:33:39.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35422024-12-20T21:33:39.558ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
35432024-12-20T21:33:39.558ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.302123ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
35442024-12-20T21:33:39.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35452024-12-20T21:33:39.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35462024-12-20T21:33:39.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.755417ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35472024-12-20T21:33:40.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 03a1e3e4-e312-4874-9cfc-d683241c0f32 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35482024-12-20T21:33:40.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 03a1e3e4-e312-4874-9cfc-d683241c0f32 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35492024-12-20T21:33:40.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 03a1e3e4-e312-4874-9cfc-d683241c0f32 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35502024-12-20T21:33:41.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = aea8f7a9-2c64-4e02-a2d4-d7e0e1651df0 roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
35512024-12-20T21:33:41.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = aea8f7a9-2c64-4e02-a2d4-d7e0e1651df0 resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
35522024-12-20T21:33:41.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = aea8f7a9-2c64-4e02-a2d4-d7e0e1651df0 response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
35532024-12-20T21:33:41.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = c6a0a67d-0de5-4629-a4b9-c191a9e9b840 roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
35542024-12-20T21:33:41.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = c6a0a67d-0de5-4629-a4b9-c191a9e9b840 resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
35552024-12-20T21:33:41.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = c6a0a67d-0de5-4629-a4b9-c191a9e9b840 response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
35562024-12-20T21:33:41.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2fb6ac2a-4967-4a04-934f-9767da49157c roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35572024-12-20T21:33:41.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2fb6ac2a-4967-4a04-934f-9767da49157c resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35582024-12-20T21:33:41.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2472 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2fb6ac2a-4967-4a04-934f-9767da49157c response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35592024-12-20T21:33:42.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 27de3f00-ed75-4e36-8c97-04ddbf586f6c roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35602024-12-20T21:33:42.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 27de3f00-ed75-4e36-8c97-04ddbf586f6c resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35612024-12-20T21:33:42.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2653 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 27de3f00-ed75-4e36-8c97-04ddbf586f6c response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35622024-12-20T21:33:43.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bc1b1028-1ea4-4c1e-8aeb-382866aa8669 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35632024-12-20T21:33:43.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bc1b1028-1ea4-4c1e-8aeb-382866aa8669 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35642024-12-20T21:33:43.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bc1b1028-1ea4-4c1e-8aeb-382866aa8669 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35652024-12-20T21:33:44.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8ce8d0ea-2353-46f5-9b08-604c05028ece roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35662024-12-20T21:33:44.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8ce8d0ea-2353-46f5-9b08-604c05028ece resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35672024-12-20T21:33:44.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8ce8d0ea-2353-46f5-9b08-604c05028ece response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35682024-12-20T21:33:45.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 79f816ac-601a-4be5-91a1-258c6c7ec277 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35692024-12-20T21:33:45.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 79f816ac-601a-4be5-91a1-258c6c7ec277 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35702024-12-20T21:33:45.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 79f816ac-601a-4be5-91a1-258c6c7ec277 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35712024-12-20T21:33:46.406ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 554 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 16e6be11-2465-48e1-9ef8-0322f839852c response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
35722024-12-20T21:33:46.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7a486383-719f-4dc1-9d5c-9accbf56bbf1 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35732024-12-20T21:33:46.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7a486383-719f-4dc1-9d5c-9accbf56bbf1 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35742024-12-20T21:33:46.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2351 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7a486383-719f-4dc1-9d5c-9accbf56bbf1 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35752024-12-20T21:33:47.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 428ea00e-7081-4308-b82a-2d815785bbe6 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35762024-12-20T21:33:47.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 428ea00e-7081-4308-b82a-2d815785bbe6 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35772024-12-20T21:33:47.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1643 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 428ea00e-7081-4308-b82a-2d815785bbe6 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35782024-12-20T21:33:48.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f41119ed-27f2-461c-a010-01f12d8da4bb roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35792024-12-20T21:33:48.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f41119ed-27f2-461c-a010-01f12d8da4bb resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35802024-12-20T21:33:48.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f41119ed-27f2-461c-a010-01f12d8da4bb response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
35812024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
35822024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
35832024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35842024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35852024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
35862024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
35872024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35882024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35892024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35902024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
35912024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35922024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
35932024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
35942024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35952024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
35962024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
35972024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35982024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
35992024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36002024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
36012024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
36022024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36032024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
36042024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
36052024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36062024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36072024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
36082024-12-20T21:33:49.539ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
36092024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36102024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
36112024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36122024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
36132024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36142024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
36152024-12-20T21:33:49.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
36162024-12-20T21:33:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36172024-12-20T21:33:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36182024-12-20T21:33:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
36192024-12-20T21:33:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36202024-12-20T21:33:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
36212024-12-20T21:33:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36222024-12-20T21:33:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36232024-12-20T21:33:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36242024-12-20T21:33:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36252024-12-20T21:33:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36262024-12-20T21:33:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36272024-12-20T21:33:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36282024-12-20T21:33:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36292024-12-20T21:33:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
36302024-12-20T21:33:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36312024-12-20T21:33:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36322024-12-20T21:33:49.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36332024-12-20T21:33:49.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36342024-12-20T21:33:49.543ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.317737ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36352024-12-20T21:33:49.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36362024-12-20T21:33:49.544ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1528, tv_nsec: 823640059 } })
36372024-12-20T21:33:49.544ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1528, tv_nsec: 823801022 } })
36382024-12-20T21:33:49.545ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
36392024-12-20T21:33:49.545ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
36402024-12-20T21:33:49.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
36412024-12-20T21:33:49.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36422024-12-20T21:33:49.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36432024-12-20T21:33:49.548ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36442024-12-20T21:33:49.548ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36452024-12-20T21:33:49.550ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36462024-12-20T21:33:49.550ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36472024-12-20T21:33:49.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36482024-12-20T21:33:49.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
36492024-12-20T21:33:49.551ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36502024-12-20T21:33:49.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36512024-12-20T21:33:49.555ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36522024-12-20T21:33:49.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36532024-12-20T21:33:49.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 38.401961ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
36542024-12-20T21:33:49.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36552024-12-20T21:33:49.582ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36562024-12-20T21:33:49.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36572024-12-20T21:33:49.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36582024-12-20T21:33:49.584ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36592024-12-20T21:33:49.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36602024-12-20T21:33:49.585ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36612024-12-20T21:33:49.586ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36622024-12-20T21:33:49.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36632024-12-20T21:33:49.586ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36642024-12-20T21:33:49.586ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
36652024-12-20T21:33:49.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36662024-12-20T21:33:49.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36672024-12-20T21:33:49.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36682024-12-20T21:33:49.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36692024-12-20T21:33:49.588ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36702024-12-20T21:33:49.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36712024-12-20T21:33:49.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36722024-12-20T21:33:49.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36732024-12-20T21:33:49.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36742024-12-20T21:33:49.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36752024-12-20T21:33:49.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36762024-12-20T21:33:49.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36772024-12-20T21:33:49.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.422485ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
36782024-12-20T21:33:49.592ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36792024-12-20T21:33:49.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36802024-12-20T21:33:49.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36812024-12-20T21:33:49.593ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36822024-12-20T21:33:49.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36832024-12-20T21:33:49.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36842024-12-20T21:33:49.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36852024-12-20T21:33:49.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
36862024-12-20T21:33:49.595ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36872024-12-20T21:33:49.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36882024-12-20T21:33:49.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c74ff24-982c-40fd-86fd-ef04898c5922, lookup_type: ById(8c74ff24-982c-40fd-86fd-ef04898c5922) } result = Ok(())
36892024-12-20T21:33:49.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36902024-12-20T21:33:49.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36912024-12-20T21:33:49.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36922024-12-20T21:33:49.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36932024-12-20T21:33:49.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36942024-12-20T21:33:49.598ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.440992ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36952024-12-20T21:33:49.599ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 59.76226ms iteration = 24 status = 0
36962024-12-20T21:33:49.599ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1528, tv_nsec: 878578620 } })
36972024-12-20T21:33:49.600ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
36982024-12-20T21:33:49.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36992024-12-20T21:33:49.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37002024-12-20T21:33:49.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37012024-12-20T21:33:49.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
37022024-12-20T21:33:49.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37032024-12-20T21:33:49.602ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37042024-12-20T21:33:49.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37052024-12-20T21:33:49.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37062024-12-20T21:33:49.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37072024-12-20T21:33:49.606ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
37082024-12-20T21:33:49.606ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37092024-12-20T21:33:49.607ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d536729f-3c37-4bdf-a250-e04508321a47", "content-length": "26", "date": "Fri, 20 Dec 2024 21:33:48 GMT"} })
37102024-12-20T21:33:49.607ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37112024-12-20T21:33:49.609ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37122024-12-20T21:33:49.611ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37132024-12-20T21:33:49.611ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
37142024-12-20T21:33:49.611ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 72.330892ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
37152024-12-20T21:33:49.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37162024-12-20T21:33:49.613ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
37172024-12-20T21:33:49.613ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 73.809945ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
37182024-12-20T21:33:49.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 77014239-1cdb-46cc-a81f-3fbb362c1300 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
37192024-12-20T21:33:49.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 77014239-1cdb-46cc-a81f-3fbb362c1300 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
37202024-12-20T21:33:49.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 75.895752ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
37212024-12-20T21:33:49.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1865 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 77014239-1cdb-46cc-a81f-3fbb362c1300 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
37222024-12-20T21:33:49.623ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 84.411583ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37232024-12-20T21:33:49.633ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.808454ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37242024-12-20T21:33:49.639ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37252024-12-20T21:33:49.639ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
37262024-12-20T21:33:49.639ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37272024-12-20T21:33:49.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37282024-12-20T21:33:49.647ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
37292024-12-20T21:33:49.647ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37302024-12-20T21:33:49.647ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee96438a-9654-4431-9b1f-e0c5e77e4d8c", "content-length": "26", "date": "Fri, 20 Dec 2024 21:33:48 GMT"} })
37312024-12-20T21:33:49.647ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37322024-12-20T21:33:49.649ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37332024-12-20T21:33:49.680ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37342024-12-20T21:33:49.680ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37352024-12-20T21:33:49.680ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 140.680285ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
37362024-12-20T21:33:49.701ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 162.308289ms iteration = 27 status = {"physical_disks_added":0}
37372024-12-20T21:33:49.708ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
37382024-12-20T21:33:49.708ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1f95fa2-61b1-4167-9503-f65f2eedb4ee", "content-length": "1", "date": "Fri, 20 Dec 2024 21:33:48 GMT"} })
37392024-12-20T21:33:49.710ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37402024-12-20T21:33:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37412024-12-20T21:33:49.713ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 173.800608ms iteration = 24 status = null
37422024-12-20T21:33:49.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37432024-12-20T21:33:49.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37442024-12-20T21:33:49.728ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac zone_address = fd00:1122:3344:101::2
37452024-12-20T21:33:49.728ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37462024-12-20T21:33:49.729ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f80513b4-86a0-46af-960e-ca214a758ce7", "content-length": "26", "date": "Fri, 20 Dec 2024 21:33:48 GMT"} })
37472024-12-20T21:33:49.729ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37482024-12-20T21:33:49.731ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
37492024-12-20T21:33:49.791ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
37502024-12-20T21:33:49.791ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37512024-12-20T21:33:49.792ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c46a5e27-cd38-445b-9ffc-614e924a653d", "content-length": "372", "date": "Fri, 20 Dec 2024 21:33:49 GMT"} })
37522024-12-20T21:33:49.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37532024-12-20T21:33:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37542024-12-20T21:33:49.801ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 262.184369ms iteration = 24 status = {}
37552024-12-20T21:33:49.837ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37562024-12-20T21:33:49.840ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37572024-12-20T21:33:49.840ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37582024-12-20T21:33:49.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37592024-12-20T21:33:49.851ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
37602024-12-20T21:33:49.851ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37612024-12-20T21:33:49.851ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b37a61e1-0fe9-45ad-8df6-d7420aa39c03", "date": "Fri, 20 Dec 2024 21:33:49 GMT"} })
37622024-12-20T21:33:49.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37632024-12-20T21:33:49.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37642024-12-20T21:33:49.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37652024-12-20T21:33:49.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37662024-12-20T21:33:49.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37672024-12-20T21:33:49.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37682024-12-20T21:33:49.860ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37692024-12-20T21:33:49.860ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37702024-12-20T21:33:49.860ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "70d04a0e-0c2a-4d12-8a2f-9b4c14c8b8e8", "date": "Fri, 20 Dec 2024 21:33:49 GMT"} })
37712024-12-20T21:33:49.861ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 322.279077ms iteration = 24 status = {}
37722024-12-20T21:33:49.869ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37732024-12-20T21:33:49.871ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37742024-12-20T21:33:49.872ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37752024-12-20T21:33:49.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37762024-12-20T21:33:49.879ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37772024-12-20T21:33:49.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37782024-12-20T21:33:49.881ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 583388f4-92af-4a10-817c-62f2e9571310, rack_id: a7e68df9-95f5-4fda-aae0-2f46483e29ac, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bacaa666-9eda-4bc8-9ccd-35df228fd476) } rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
37792024-12-20T21:33:49.881ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37802024-12-20T21:33:49.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37812024-12-20T21:33:49.891ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37822024-12-20T21:33:49.892ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cdb2323-1833-40e4-b468-fa8fd123108e", "content-length": "134", "date": "Fri, 20 Dec 2024 21:33:49 GMT"} })
37832024-12-20T21:33:49.892ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37842024-12-20T21:33:49.892ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bacaa666-9eda-4bc8-9ccd-35df228fd476
37852024-12-20T21:33:49.892ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37862024-12-20T21:33:49.892ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37872024-12-20T21:33:49.892ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37882024-12-20T21:33:49.892ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37892024-12-20T21:33:49.892ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37902024-12-20T21:33:49.892ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37912024-12-20T21:33:49.892ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37922024-12-20T21:33:49.892ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37932024-12-20T21:33:49.893ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
37942024-12-20T21:33:49.893ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37952024-12-20T21:33:49.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37962024-12-20T21:33:49.895ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37972024-12-20T21:33:49.895ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c74e6ec8-f197-4c79-ad2a-8644f64fecf8", "content-length": "2", "date": "Fri, 20 Dec 2024 21:33:49 GMT"} })
37982024-12-20T21:33:49.896ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
37992024-12-20T21:33:49.896ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0590288c-fe10-4557-9ae1-f81ecca02a52", "content-length": "52", "date": "Fri, 20 Dec 2024 21:33:49 GMT"} })
38002024-12-20T21:33:49.896ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
38012024-12-20T21:33:49.896ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38022024-12-20T21:33:49.983ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
38032024-12-20T21:33:50.029ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d6a447fd-3429-412c-b6a4-97eae2ed41ee", "date": "Fri, 20 Dec 2024 21:33:49 GMT"} })
38042024-12-20T21:33:50.029ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch = Switch0
38052024-12-20T21:33:50.029ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38062024-12-20T21:33:50.030ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "592d7fa2-ff27-43d0-a170-22ec87a66b78", "content-length": "691", "date": "Fri, 20 Dec 2024 21:33:49 GMT"} })
38072024-12-20T21:33:50.030ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
38082024-12-20T21:33:50.030ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
38092024-12-20T21:33:50.030ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
38102024-12-20T21:33:50.030ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a1178ae-158f-420d-9e7c-07b221888a9c", "content-length": "682", "date": "Fri, 20 Dec 2024 21:33:49 GMT"} })
38112024-12-20T21:33:50.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38122024-12-20T21:33:50.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38132024-12-20T21:33:50.031ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 492.36432ms iteration = 24 status = {}
38142024-12-20T21:33:50.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38152024-12-20T21:33:50.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38162024-12-20T21:33:50.038ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38172024-12-20T21:33:50.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38182024-12-20T21:33:50.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38192024-12-20T21:33:50.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38202024-12-20T21:33:50.052ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 512.594164ms iteration = 24 status = {}
38212024-12-20T21:33:50.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a42ef68e-8854-43c0-a500-66b3e2588a2b roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38222024-12-20T21:33:50.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a42ef68e-8854-43c0-a500-66b3e2588a2b resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38232024-12-20T21:33:50.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a42ef68e-8854-43c0-a500-66b3e2588a2b response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38242024-12-20T21:33:50.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 4175b9fb-9356-4ec9-ae94-0e76049f67cb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
38252024-12-20T21:33:50.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 4175b9fb-9356-4ec9-ae94-0e76049f67cb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
38262024-12-20T21:33:50.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 4175b9fb-9356-4ec9-ae94-0e76049f67cb response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
38272024-12-20T21:33:51.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9c789136-faf3-41b1-a997-4f984d395e57 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38282024-12-20T21:33:51.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9c789136-faf3-41b1-a997-4f984d395e57 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38292024-12-20T21:33:51.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9c789136-faf3-41b1-a997-4f984d395e57 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38302024-12-20T21:33:52.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bef49c1f-b659-41d9-8f22-a099264e6c8d roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38312024-12-20T21:33:52.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bef49c1f-b659-41d9-8f22-a099264e6c8d resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38322024-12-20T21:33:52.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bef49c1f-b659-41d9-8f22-a099264e6c8d response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38332024-12-20T21:33:53.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7a56822a-c826-47eb-967a-d87f5bf79b36 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38342024-12-20T21:33:53.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7a56822a-c826-47eb-967a-d87f5bf79b36 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38352024-12-20T21:33:53.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2909 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7a56822a-c826-47eb-967a-d87f5bf79b36 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38362024-12-20T21:33:53.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 76e63a7c-a117-4e8a-8841-7fff5a9042bf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
38372024-12-20T21:33:53.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 76e63a7c-a117-4e8a-8841-7fff5a9042bf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
38382024-12-20T21:33:53.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 76e63a7c-a117-4e8a-8841-7fff5a9042bf response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
38392024-12-20T21:33:53.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 4afba6a4-86f8-4877-9f8c-2ed8c2b0474d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
38402024-12-20T21:33:53.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 4afba6a4-86f8-4877-9f8c-2ed8c2b0474d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
38412024-12-20T21:33:53.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 4afba6a4-86f8-4877-9f8c-2ed8c2b0474d response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
38422024-12-20T21:33:54.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6aa577c0-ff70-455b-af90-fbea09189c16 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38432024-12-20T21:33:54.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6aa577c0-ff70-455b-af90-fbea09189c16 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38442024-12-20T21:33:54.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6aa577c0-ff70-455b-af90-fbea09189c16 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38452024-12-20T21:33:55.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 761880ca-5a69-4337-8463-b7c4ac36fa92 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38462024-12-20T21:33:55.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 761880ca-5a69-4337-8463-b7c4ac36fa92 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38472024-12-20T21:33:55.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 761880ca-5a69-4337-8463-b7c4ac36fa92 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38482024-12-20T21:33:56.406ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 911 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = e71e1474-3aa2-4034-90d0-670202ca54fc response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
38492024-12-20T21:33:56.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = afbb0a03-6b66-41fd-9aa9-fe619ad8d286 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38502024-12-20T21:33:56.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = afbb0a03-6b66-41fd-9aa9-fe619ad8d286 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38512024-12-20T21:33:56.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3282 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = afbb0a03-6b66-41fd-9aa9-fe619ad8d286 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38522024-12-20T21:33:57.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = efe05605-5187-46d1-bd6c-dffc864a9fb0 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38532024-12-20T21:33:57.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = efe05605-5187-46d1-bd6c-dffc864a9fb0 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38542024-12-20T21:33:57.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = efe05605-5187-46d1-bd6c-dffc864a9fb0 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38552024-12-20T21:33:58.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fe0a79e9-ac32-46cb-a054-855391493600 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38562024-12-20T21:33:58.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fe0a79e9-ac32-46cb-a054-855391493600 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38572024-12-20T21:33:58.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1939 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fe0a79e9-ac32-46cb-a054-855391493600 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38582024-12-20T21:33:59.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
38592024-12-20T21:33:59.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
38602024-12-20T21:33:59.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38612024-12-20T21:33:59.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38622024-12-20T21:33:59.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38632024-12-20T21:33:59.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38642024-12-20T21:33:59.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38652024-12-20T21:33:59.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38662024-12-20T21:33:59.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38672024-12-20T21:33:59.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38682024-12-20T21:33:59.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38692024-12-20T21:33:59.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38702024-12-20T21:33:59.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38712024-12-20T21:33:59.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
38722024-12-20T21:33:59.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38732024-12-20T21:33:59.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38742024-12-20T21:33:59.563ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
38752024-12-20T21:33:59.563ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.852005ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
38762024-12-20T21:33:59.569ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38772024-12-20T21:33:59.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38782024-12-20T21:33:59.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.534527ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38792024-12-20T21:33:59.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 25b83747-6da5-434a-868e-72615291345d roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38802024-12-20T21:33:59.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 25b83747-6da5-434a-868e-72615291345d resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38812024-12-20T21:33:59.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 25b83747-6da5-434a-868e-72615291345d response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38822024-12-20T21:34:00.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 69eebbd1-a9fc-4e1a-92c2-60cbcc8cda81 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38832024-12-20T21:34:00.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 69eebbd1-a9fc-4e1a-92c2-60cbcc8cda81 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38842024-12-20T21:34:00.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 69eebbd1-a9fc-4e1a-92c2-60cbcc8cda81 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38852024-12-20T21:34:01.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9f97c83c-a1b3-4841-95cb-0c72e85fa5eb roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38862024-12-20T21:34:01.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9f97c83c-a1b3-4841-95cb-0c72e85fa5eb resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38872024-12-20T21:34:01.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9f97c83c-a1b3-4841-95cb-0c72e85fa5eb response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38882024-12-20T21:34:02.051ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f6bad467-a635-4e8a-b9bc-5d0c877ff60c remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fd6bd034-c052-41dc-80ba-1f27acd2ef30 uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-20T21:34:02.030627511Z }
38892024-12-20T21:34:02.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fd6bd034-c052-41dc-80ba-1f27acd2ef30 roles = RoleSet { roles: {} } uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
38902024-12-20T21:34:02.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fd6bd034-c052-41dc-80ba-1f27acd2ef30 resource = Database result = Ok(()) uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
38912024-12-20T21:34:02.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51260 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fd6bd034-c052-41dc-80ba-1f27acd2ef30 response_code = 204 uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
38922024-12-20T21:34:02.082ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f6bad467-a635-4e8a-b9bc-5d0c877ff60c remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b63e659b-9361-45c2-bc79-817651b9f42d uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-20T21:34:02.082535335Z }
38932024-12-20T21:34:02.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b63e659b-9361-45c2-bc79-817651b9f42d roles = RoleSet { roles: {} } uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
38942024-12-20T21:34:02.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b63e659b-9361-45c2-bc79-817651b9f42d resource = Database result = Ok(()) uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
38952024-12-20T21:34:02.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41990 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b63e659b-9361-45c2-bc79-817651b9f42d response_code = 204 uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
38962024-12-20T21:34:02.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7110e1e4-5530-4458-8a33-1b0028a81b4e roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38972024-12-20T21:34:02.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7110e1e4-5530-4458-8a33-1b0028a81b4e resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38982024-12-20T21:34:02.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1795 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7110e1e4-5530-4458-8a33-1b0028a81b4e response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
38992024-12-20T21:34:03.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = aa32c99b-b703-4dab-a87d-6a08a93b7b07 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39002024-12-20T21:34:03.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = aa32c99b-b703-4dab-a87d-6a08a93b7b07 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39012024-12-20T21:34:03.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = aa32c99b-b703-4dab-a87d-6a08a93b7b07 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39022024-12-20T21:34:04.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1a926d59-44ac-4218-93e8-b90754374066 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39032024-12-20T21:34:04.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1a926d59-44ac-4218-93e8-b90754374066 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39042024-12-20T21:34:04.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2665 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1a926d59-44ac-4218-93e8-b90754374066 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39052024-12-20T21:34:06.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 788c9529-8333-487c-8ea1-5bcae3b61939 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39062024-12-20T21:34:06.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 788c9529-8333-487c-8ea1-5bcae3b61939 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39072024-12-20T21:34:06.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2801 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 788c9529-8333-487c-8ea1-5bcae3b61939 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39082024-12-20T21:34:06.406ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 572 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 80db6ff8-853b-4528-800e-8d411d74be27 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
39092024-12-20T21:34:07.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6644a3bb-300f-431d-88f6-a0158b1cd868 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39102024-12-20T21:34:07.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6644a3bb-300f-431d-88f6-a0158b1cd868 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39112024-12-20T21:34:07.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6644a3bb-300f-431d-88f6-a0158b1cd868 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39122024-12-20T21:34:08.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c9f11866-9eac-4a5a-a024-b3fd9f10cc0d roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39132024-12-20T21:34:08.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c9f11866-9eac-4a5a-a024-b3fd9f10cc0d resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39142024-12-20T21:34:08.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c9f11866-9eac-4a5a-a024-b3fd9f10cc0d response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39152024-12-20T21:34:09.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9318420b-ebe7-4828-9e53-d3212163a583 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39162024-12-20T21:34:09.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9318420b-ebe7-4828-9e53-d3212163a583 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39172024-12-20T21:34:09.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1858 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9318420b-ebe7-4828-9e53-d3212163a583 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39182024-12-20T21:34:09.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
39192024-12-20T21:34:09.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
39202024-12-20T21:34:09.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39212024-12-20T21:34:09.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39222024-12-20T21:34:09.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39232024-12-20T21:34:09.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39242024-12-20T21:34:09.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39252024-12-20T21:34:09.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39262024-12-20T21:34:09.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39272024-12-20T21:34:09.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39282024-12-20T21:34:09.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39292024-12-20T21:34:09.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39302024-12-20T21:34:09.568ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39312024-12-20T21:34:09.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39322024-12-20T21:34:09.570ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.859042ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39332024-12-20T21:34:09.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39342024-12-20T21:34:09.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
39352024-12-20T21:34:09.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39362024-12-20T21:34:09.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39372024-12-20T21:34:09.586ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
39382024-12-20T21:34:09.586ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.418211ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
39392024-12-20T21:34:10.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1b67f545-1bbd-4011-8d92-2170e9fb7b09 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39402024-12-20T21:34:10.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1b67f545-1bbd-4011-8d92-2170e9fb7b09 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39412024-12-20T21:34:10.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1718 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1b67f545-1bbd-4011-8d92-2170e9fb7b09 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39422024-12-20T21:34:11.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 86d6e677-ac5d-419b-898a-c75ef704dd01 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39432024-12-20T21:34:11.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 86d6e677-ac5d-419b-898a-c75ef704dd01 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39442024-12-20T21:34:11.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 86d6e677-ac5d-419b-898a-c75ef704dd01 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39452024-12-20T21:34:11.316ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f6bad467-a635-4e8a-b9bc-5d0c877ff60c remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 08f1745d-a4bd-4d45-8f38-589c5a04c2ae uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-20T21:34:11.315869054Z }
39462024-12-20T21:34:11.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 08f1745d-a4bd-4d45-8f38-589c5a04c2ae roles = RoleSet { roles: {} } uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39472024-12-20T21:34:11.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 08f1745d-a4bd-4d45-8f38-589c5a04c2ae resource = Database result = Ok(()) uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39482024-12-20T21:34:11.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38952 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 08f1745d-a4bd-4d45-8f38-589c5a04c2ae response_code = 204 uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39492024-12-20T21:34:11.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = 08bdac05-54dc-4ed2-90cd-44209a255380 roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
39502024-12-20T21:34:11.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = 08bdac05-54dc-4ed2-90cd-44209a255380 resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
39512024-12-20T21:34:11.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = 08bdac05-54dc-4ed2-90cd-44209a255380 response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
39522024-12-20T21:34:11.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = 93acbb61-28a2-433c-aded-57cb723bc893 roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
39532024-12-20T21:34:11.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = 93acbb61-28a2-433c-aded-57cb723bc893 resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
39542024-12-20T21:34:11.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2150 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44378 req_id = 93acbb61-28a2-433c-aded-57cb723bc893 response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
39552024-12-20T21:34:11.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 8aa316fa-4087-4abb-9c6c-ad4d3de969dd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
39562024-12-20T21:34:11.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 8aa316fa-4087-4abb-9c6c-ad4d3de969dd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
39572024-12-20T21:34:11.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3590 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 8aa316fa-4087-4abb-9c6c-ad4d3de969dd response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
39582024-12-20T21:34:11.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = e934bd47-31db-471f-b535-956b44292421 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
39592024-12-20T21:34:11.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = e934bd47-31db-471f-b535-956b44292421 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
39602024-12-20T21:34:11.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2955 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = e934bd47-31db-471f-b535-956b44292421 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
39612024-12-20T21:34:12.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ca4dfa40-5593-45bd-a738-3557ec28d148 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39622024-12-20T21:34:12.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ca4dfa40-5593-45bd-a738-3557ec28d148 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39632024-12-20T21:34:12.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1819 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ca4dfa40-5593-45bd-a738-3557ec28d148 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39642024-12-20T21:34:13.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 92d3a3d1-2bfd-4671-a0ef-ce9d89fd12d9 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39652024-12-20T21:34:13.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 92d3a3d1-2bfd-4671-a0ef-ce9d89fd12d9 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39662024-12-20T21:34:13.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 92d3a3d1-2bfd-4671-a0ef-ce9d89fd12d9 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39672024-12-20T21:34:13.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 7227d52a-957a-47b6-84ed-8db1acafcbd9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
39682024-12-20T21:34:13.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 7227d52a-957a-47b6-84ed-8db1acafcbd9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
39692024-12-20T21:34:13.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 7227d52a-957a-47b6-84ed-8db1acafcbd9 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
39702024-12-20T21:34:13.921ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f6bad467-a635-4e8a-b9bc-5d0c877ff60c remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07be7337-3acf-4bae-a4df-b978f2bfdedd uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-20T21:34:13.920900177Z }
39712024-12-20T21:34:13.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07be7337-3acf-4bae-a4df-b978f2bfdedd roles = RoleSet { roles: {} } uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39722024-12-20T21:34:13.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07be7337-3acf-4bae-a4df-b978f2bfdedd resource = Database result = Ok(()) uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39732024-12-20T21:34:13.982ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = f6bad467-a635-4e8a-b9bc-5d0c877ff60c remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07be7337-3acf-4bae-a4df-b978f2bfdedd uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c vmm_needs_update = true
39742024-12-20T21:34:13.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07be7337-3acf-4bae-a4df-b978f2bfdedd roles = RoleSet { roles: {} } uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39752024-12-20T21:34:13.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07be7337-3acf-4bae-a4df-b978f2bfdedd resource = Database result = Ok(()) uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39762024-12-20T21:34:13.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07be7337-3acf-4bae-a4df-b978f2bfdedd roles = RoleSet { roles: {} } uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39772024-12-20T21:34:13.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07be7337-3acf-4bae-a4df-b978f2bfdedd resource = Database result = Ok(()) uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39782024-12-20T21:34:14.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07be7337-3acf-4bae-a4df-b978f2bfdedd roles = RoleSet { roles: {} } uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39792024-12-20T21:34:14.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07be7337-3acf-4bae-a4df-b978f2bfdedd resource = Database result = Ok(()) uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39802024-12-20T21:34:14.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07be7337-3acf-4bae-a4df-b978f2bfdedd roles = RoleSet { roles: {} } uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39812024-12-20T21:34:14.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07be7337-3acf-4bae-a4df-b978f2bfdedd resource = Database result = Ok(()) uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39822024-12-20T21:34:14.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07be7337-3acf-4bae-a4df-b978f2bfdedd roles = RoleSet { roles: {} } uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39832024-12-20T21:34:14.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07be7337-3acf-4bae-a4df-b978f2bfdedd resource = Database result = Ok(()) uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39842024-12-20T21:34:14.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07be7337-3acf-4bae-a4df-b978f2bfdedd roles = RoleSet { roles: {} } uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39852024-12-20T21:34:14.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07be7337-3acf-4bae-a4df-b978f2bfdedd resource = Database result = Ok(()) uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39862024-12-20T21:34:14.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07be7337-3acf-4bae-a4df-b978f2bfdedd roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39872024-12-20T21:34:14.038ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07be7337-3acf-4bae-a4df-b978f2bfdedd resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 66e8bce1-b95a-4433-886f-e35fda6d9a14, lookup_type: ById(66e8bce1-b95a-4433-886f-e35fda6d9a14) }, key: 40304ee1-a5ea-4982-8a07-932d1d13f50e, lookup_type: ById(40304ee1-a5ea-4982-8a07-932d1d13f50e) }, key: 4e1d5d1c-803b-4f76-ae75-2577f45db478, lookup_type: ById(4e1d5d1c-803b-4f76-ae75-2577f45db478) } result = Ok(()) uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39882024-12-20T21:34:14.043ZINFOnexus (dropshot_internal): starting update saga for 4e1d5d1c-803b-4f76-ae75-2577f45db478 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1583 instance_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07be7337-3acf-4bae-a4df-b978f2bfdedd uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-20T21:34:13.920900177Z }
39892024-12-20T21:34:14.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122727 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07be7337-3acf-4bae-a4df-b978f2bfdedd response_code = 204 uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39902024-12-20T21:34:14.043ZDEBGnexus (dropshot_internal): preparing instance-update saga for 4e1d5d1c-803b-4f76-ae75-2577f45db478... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 07be7337-3acf-4bae-a4df-b978f2bfdedd uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39912024-12-20T21:34:14.043ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update
39922024-12-20T21:34:14.044ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f6bad467-a635-4e8a-b9bc-5d0c877ff60c remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 300619fb-2cd3-4392-a45e-709e8f07f46c uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-20T21:34:13.920900177Z }
39932024-12-20T21:34:14.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 300619fb-2cd3-4392-a45e-709e8f07f46c roles = RoleSet { roles: {} } uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39942024-12-20T21:34:14.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 300619fb-2cd3-4392-a45e-709e8f07f46c resource = Database result = Ok(()) uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39952024-12-20T21:34:14.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3727 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 300619fb-2cd3-4392-a45e-709e8f07f46c response_code = 204 uri = /vmms/f6bad467-a635-4e8a-b9bc-5d0c877ff60c
39962024-12-20T21:34:14.075ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"4e1d5d1c-803b-4f76-ae75-2577f45db478","lookup_type":{"ById":"4e1d5d1c-803b-4f76-ae75-2577f45db478"},"parent":{"key":"40304ee1-a5ea-4982-8a07-932d1d13f50e","lookup_type":{"ById":"40304ee1-a5ea-4982-8a07-932d1d13f50e"},"parent":{"key":"66e8bce1-b95a-4433-886f-e35fda6d9a14","lookup_type":{"ById":"66e8bce1-b95a-4433-886f-e35fda6d9a14"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
39972024-12-20T21:34:14.077ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update
39982024-12-20T21:34:14.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 816dce42-f81c-4a3c-81ee-f0d4ed38de45 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
39992024-12-20T21:34:14.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 816dce42-f81c-4a3c-81ee-f0d4ed38de45 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
40002024-12-20T21:34:14.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 816dce42-f81c-4a3c-81ee-f0d4ed38de45 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
40012024-12-20T21:34:14.232ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update
40022024-12-20T21:34:14.232ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
40032024-12-20T21:34:14.232ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
40042024-12-20T21:34:14.232ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae
40052024-12-20T21:34:14.260ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
40062024-12-20T21:34:14.260ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae
40072024-12-20T21:34:14.285ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
40082024-12-20T21:34:14.285ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae
40092024-12-20T21:34:14.305ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
40102024-12-20T21:34:14.305ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("770d8271-424f-4a54-bb76-553ff8258dda")) node_id = 0 saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae
40112024-12-20T21:34:14.310ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
40122024-12-20T21:34:14.310ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae
40132024-12-20T21:34:14.348ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update
40142024-12-20T21:34:14.350ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = LockInstance
40152024-12-20T21:34:14.351ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = LockInstance
40162024-12-20T21:34:14.353ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = LockInstance
40172024-12-20T21:34:14.353ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = LockInstance
40182024-12-20T21:34:14.355ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = LockInstance
40192024-12-20T21:34:14.355ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = LockInstance
40202024-12-20T21:34:14.357ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = LockInstance
40212024-12-20T21:34:14.357ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = LockInstance
40222024-12-20T21:34:14.359ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = LockInstance
40232024-12-20T21:34:14.359ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = LockInstance
40242024-12-20T21:34:14.360ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = LockInstance
40252024-12-20T21:34:14.360ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = LockInstance
40262024-12-20T21:34:14.362ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = LockInstance
40272024-12-20T21:34:14.373ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 66e8bce1-b95a-4433-886f-e35fda6d9a14, lookup_type: ById(66e8bce1-b95a-4433-886f-e35fda6d9a14) }, key: 40304ee1-a5ea-4982-8a07-932d1d13f50e, lookup_type: ById(40304ee1-a5ea-4982-8a07-932d1d13f50e) }, key: 4e1d5d1c-803b-4f76-ae75-2577f45db478, lookup_type: ById(4e1d5d1c-803b-4f76-ae75-2577f45db478) } result = Ok(()) saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = LockInstance
40282024-12-20T21:34:14.373ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = LockInstance updater_id = 770d8271-424f-4a54-bb76-553ff8258dda
40292024-12-20T21:34:14.373ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = LockInstance
40302024-12-20T21:34:14.373ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = LockInstance
40312024-12-20T21:34:14.423ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = LockInstance updater_id = 770d8271-424f-4a54-bb76-553ff8258dda
40322024-12-20T21:34:14.423ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = LockInstance
40332024-12-20T21:34:14.423ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = LockInstance
40342024-12-20T21:34:14.427ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 locked_gen = Generation(Generation(2)) saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = LockInstance updater_id = 770d8271-424f-4a54-bb76-553ff8258dda
40352024-12-20T21:34:14.438ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
40362024-12-20T21:34:14.438ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("770d8271-424f-4a54-bb76-553ff8258dda")}) node_id = 1 saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae
40372024-12-20T21:34:14.469ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
40382024-12-20T21:34:14.469ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae
40392024-12-20T21:34:14.564ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
40402024-12-20T21:34:14.565ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
40412024-12-20T21:34:14.566ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
40422024-12-20T21:34:14.566ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
40432024-12-20T21:34:14.568ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
40442024-12-20T21:34:14.568ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
40452024-12-20T21:34:14.569ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
40462024-12-20T21:34:14.572ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 66e8bce1-b95a-4433-886f-e35fda6d9a14, lookup_type: ById(66e8bce1-b95a-4433-886f-e35fda6d9a14) }, key: 40304ee1-a5ea-4982-8a07-932d1d13f50e, lookup_type: ById(40304ee1-a5ea-4982-8a07-932d1d13f50e) }, key: 4e1d5d1c-803b-4f76-ae75-2577f45db478, lookup_type: ById(4e1d5d1c-803b-4f76-ae75-2577f45db478) } result = Ok(()) saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
40472024-12-20T21:34:14.572ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
40482024-12-20T21:34:14.573ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
40492024-12-20T21:34:14.597ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: f6bad467-a635-4e8a-b9bc-5d0c877ff60c, time_created: 2024-12-20T21:33:52.620006Z, time_deleted: None, instance_id: 4e1d5d1c-803b-4f76-ae75-2577f45db478, sled_id: 8c74ff24-982c-40fd-86fd-ef04898c5922, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-12-20T21:34:13.920900Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-12-20T21:33:50.197879Z, gen: Generation(Generation(3)), propolis_id: Some(f6bad467-a635-4e8a-b9bc-5d0c877ff60c), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(f6bad467-a635-4e8a-b9bc-5d0c877ff60c (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-12-20T21:34:14.597534080Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
40502024-12-20T21:34:14.605ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update
40512024-12-20T21:34:14.618ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"4e1d5d1c-803b-4f76-ae75-2577f45db478","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"f6bad467-a635-4e8a-b9bc-5d0c877ff60c"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"4e1d5d1c-803b-4f76-ae75-2577f45db478","lookup_type":{"ById":"4e1d5d1c-803b-4f76-ae75-2577f45db478"},"parent":{"key":"40304ee1-a5ea-4982-8a07-932d1d13f50e","lookup_type":{"ById":"40304ee1-a5ea-4982-8a07-932d1d13f50e"},"parent":{"key":"66e8bce1-b95a-4433-886f-e35fda6d9a14","lookup_type":{"ById":"66e8bce1-b95a-4433-886f-e35fda6d9a14"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"770d8271-424f-4a54-bb76-553ff8258dda"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"40304ee1-a5ea-4982-8a07-932d1d13f50e","ram_diff":1073741824},"destroy_active_vmm":"f6bad467-a635-4e8a-b9bc-5d0c877ff60c","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-12-20T21:34:14.597534080Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
40522024-12-20T21:34:14.618ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update
40532024-12-20T21:34:14.695ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update
40542024-12-20T21:34:14.695ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
40552024-12-20T21:34:14.695ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
40562024-12-20T21:34:14.695ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
40572024-12-20T21:34:14.767ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
40582024-12-20T21:34:14.767ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
40592024-12-20T21:34:14.875ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
40602024-12-20T21:34:14.875ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
40612024-12-20T21:34:14.958ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
40622024-12-20T21:34:14.958ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("8ae6b7eb-9947-4b6b-9bfb-f032ced4e535")) node_id = 0 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
40632024-12-20T21:34:14.986ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
40642024-12-20T21:34:14.986ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
40652024-12-20T21:34:15.035ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 parent_lock = UpdaterLock { updater_id: 770d8271-424f-4a54-bb76-553ff8258dda, locked_gen: Generation(Generation(2)) } saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update
40662024-12-20T21:34:15.035ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = BecomeUpdater
40672024-12-20T21:34:15.035ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = BecomeUpdater
40682024-12-20T21:34:15.110ZDEBGnexus (SagaExecutor): inherited lock from 770d8271-424f-4a54-bb76-553ff8258dda to 8ae6b7eb-9947-4b6b-9bfb-f032ced4e535 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 770d8271-424f-4a54-bb76-553ff8258dda saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = BecomeUpdater updater_id = 8ae6b7eb-9947-4b6b-9bfb-f032ced4e535
40692024-12-20T21:34:15.110ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update
40702024-12-20T21:34:15.110ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
40712024-12-20T21:34:15.110ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("8ae6b7eb-9947-4b6b-9bfb-f032ced4e535")}) node_id = 1 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
40722024-12-20T21:34:15.167ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
40732024-12-20T21:34:15.167ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
40742024-12-20T21:34:15.176ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
40752024-12-20T21:34:15.176ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
40762024-12-20T21:34:15.210ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
40772024-12-20T21:34:15.210ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
40782024-12-20T21:34:15.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b5c1d36d-50f9-4197-8063-f8937bf14079 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
40792024-12-20T21:34:15.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b5c1d36d-50f9-4197-8063-f8937bf14079 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
40802024-12-20T21:34:15.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b5c1d36d-50f9-4197-8063-f8937bf14079 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
40812024-12-20T21:34:15.232ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update
40822024-12-20T21:34:15.232ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478
40832024-12-20T21:34:15.232ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = UpdateNetworkConfig
40842024-12-20T21:34:15.233ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = UpdateNetworkConfig
40852024-12-20T21:34:15.235ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = UpdateNetworkConfig
40862024-12-20T21:34:15.236ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = UpdateNetworkConfig
40872024-12-20T21:34:15.247ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
40882024-12-20T21:34:15.247ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = UpdateNetworkConfig
40892024-12-20T21:34:15.247ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = UpdateNetworkConfig
40902024-12-20T21:34:15.249ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
40912024-12-20T21:34:15.249ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
40922024-12-20T21:34:15.250ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
40932024-12-20T21:34:15.251ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
40942024-12-20T21:34:15.253ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
40952024-12-20T21:34:15.253ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
40962024-12-20T21:34:15.253ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
40972024-12-20T21:34:15.269ZDEBGnexus: notifying dendrite of updates instance_id = Some(4e1d5d1c-803b-4f76-ae75-2577f45db478 (instance)) switch = switch0
40982024-12-20T21:34:15.270ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1554, tv_nsec: 549192359 } })
40992024-12-20T21:34:15.270ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
41002024-12-20T21:34:15.301ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
41012024-12-20T21:34:15.301ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41022024-12-20T21:34:15.301ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "341d8ef9-0ae3-4bb2-9830-3d86f89e1a53", "content-length": "26", "date": "Fri, 20 Dec 2024 21:34:14 GMT"} })
41032024-12-20T21:34:15.301ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41042024-12-20T21:34:15.302ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41052024-12-20T21:34:15.331ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
41062024-12-20T21:34:15.331ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "9484feea-8da5-44d8-b072-3bf7e078b685", "content-length": "4", "date": "Fri, 20 Dec 2024 21:34:15 GMT"} })
41072024-12-20T21:34:15.333ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
41082024-12-20T21:34:15.333ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
41092024-12-20T21:34:15.363ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
41102024-12-20T21:34:15.363ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
41112024-12-20T21:34:15.421ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
41122024-12-20T21:34:15.421ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
41132024-12-20T21:34:15.459ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-12-20T21:34:15.424561Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 40304ee1-a5ea-4982-8a07-932d1d13f50e, time_modified: Some(2024-12-20T21:34:15.424561Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, time_modified: Some(2024-12-20T21:34:15.424561Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update
41142024-12-20T21:34:15.459ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
41152024-12-20T21:34:15.459ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
41162024-12-20T21:34:15.472ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
41172024-12-20T21:34:15.472ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
41182024-12-20T21:34:15.487ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update
41192024-12-20T21:34:15.487ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = UnassignOximeterProducer
41202024-12-20T21:34:15.487ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = UnassignOximeterProducer
41212024-12-20T21:34:15.514ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = f413b9dc-12d9-42dc-9e49-cb25b63f7e80 producer_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update
41222024-12-20T21:34:15.514ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = UnassignOximeterProducer
41232024-12-20T21:34:15.514ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = UnassignOximeterProducer
41242024-12-20T21:34:15.549ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update
41252024-12-20T21:34:15.551ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 4e1d5d1c-803b-4f76-ae75-2577f45db478 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/4e1d5d1c-803b-4f76-ae75-2577f45db478
41262024-12-20T21:34:15.573ZDEBGnexus (SagaExecutor): client response oximeter-collector = 4e1d5d1c-803b-4f76-ae75-2577f45db478 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/4e1d5d1c-803b-4f76-ae75-2577f45db478", status: 204, headers: {"x-request-id": "80e221a4-9e99-4797-a62d-50352fb7a4f8", "date": "Fri, 20 Dec 2024 21:34:15 GMT"} }) saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update
41272024-12-20T21:34:15.573ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = f413b9dc-12d9-42dc-9e49-cb25b63f7e80 producer_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update
41282024-12-20T21:34:15.575ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
41292024-12-20T21:34:15.575ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
41302024-12-20T21:34:15.583ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
41312024-12-20T21:34:15.583ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
41322024-12-20T21:34:15.595ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 lock = UpdaterLock { updater_id: 8ae6b7eb-9947-4b6b-9bfb-f032ced4e535, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-12-20T21:34:14.597534080Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update
41332024-12-20T21:34:15.595ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = CommitInstanceUpdates
41342024-12-20T21:34:15.595ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = CommitInstanceUpdates
41352024-12-20T21:34:15.651ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 new_runtime = InstanceRuntimeState { time_updated: 2024-12-20T21:34:14.597534080Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update
41362024-12-20T21:34:15.651ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
41372024-12-20T21:34:15.651ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
41382024-12-20T21:34:15.651ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
41392024-12-20T21:34:15.651ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Signaled
41402024-12-20T21:34:15.651ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
41412024-12-20T21:34:15.651ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41422024-12-20T21:34:15.651ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41432024-12-20T21:34:15.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41442024-12-20T21:34:15.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41452024-12-20T21:34:15.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41462024-12-20T21:34:15.655ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41472024-12-20T21:34:15.655ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41482024-12-20T21:34:15.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41492024-12-20T21:34:15.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41502024-12-20T21:34:15.658ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41512024-12-20T21:34:15.658ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41522024-12-20T21:34:15.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41532024-12-20T21:34:15.664ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
41542024-12-20T21:34:15.664ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
41552024-12-20T21:34:15.669ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
41562024-12-20T21:34:15.669ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("4e1d5d1c-803b-4f76-ae75-2577f45db478"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("f6bad467-a635-4e8a-b9bc-5d0c877ff60c")}) node_id = 7 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
41572024-12-20T21:34:15.675ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
41582024-12-20T21:34:15.675ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
41592024-12-20T21:34:15.684ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
41602024-12-20T21:34:15.684ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
41612024-12-20T21:34:15.689ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
41622024-12-20T21:34:15.689ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
41632024-12-20T21:34:15.713ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 propolis_id = f6bad467-a635-4e8a-b9bc-5d0c877ff60c saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update
41642024-12-20T21:34:15.714ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = ReleaseSledResources
41652024-12-20T21:34:15.714ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = ReleaseSledResources
41662024-12-20T21:34:15.726ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41672024-12-20T21:34:15.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41682024-12-20T21:34:15.746ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
41692024-12-20T21:34:15.746ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41702024-12-20T21:34:15.746ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c0b42e9-da51-481b-a1c9-afde3826fa41", "content-length": "372", "date": "Fri, 20 Dec 2024 21:34:15 GMT"} })
41712024-12-20T21:34:15.746ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41722024-12-20T21:34:15.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41732024-12-20T21:34:15.761ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {f63b0c86-4482-4df4-a8b3-bfaa6e884045: {10.151.1.176: {499d5cba-788b-419e-a0b2-9441bf49dce5}, 10.151.1.175: {499d5cba-788b-419e-a0b2-9441bf49dce5}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
41742024-12-20T21:34:15.761ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
41752024-12-20T21:34:15.761ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c22173e0-445c-4aeb-805b-695d453d480d", "date": "Fri, 20 Dec 2024 21:34:15 GMT"} })
41762024-12-20T21:34:15.761ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41772024-12-20T21:34:15.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41782024-12-20T21:34:15.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41792024-12-20T21:34:15.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41802024-12-20T21:34:15.765ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
41812024-12-20T21:34:15.765ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
41822024-12-20T21:34:15.767ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41832024-12-20T21:34:15.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41842024-12-20T21:34:15.771ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
41852024-12-20T21:34:15.771ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41862024-12-20T21:34:15.772ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b5b632bf-1703-4146-b588-e14ae187eb3a", "date": "Fri, 20 Dec 2024 21:34:15 GMT"} })
41872024-12-20T21:34:15.774ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 123.078549ms iteration = 25 status = {}
41882024-12-20T21:34:15.787ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
41892024-12-20T21:34:15.787ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
41902024-12-20T21:34:15.792ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 propolis_id = f6bad467-a635-4e8a-b9bc-5d0c877ff60c saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update
41912024-12-20T21:34:15.792ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = MarkVmmDeleted
41922024-12-20T21:34:15.792ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = MarkVmmDeleted
41932024-12-20T21:34:15.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 78617b05-5cb7-41ca-9085-a1308f65ac56 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
41942024-12-20T21:34:15.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 78617b05-5cb7-41ca-9085-a1308f65ac56 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
41952024-12-20T21:34:15.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2816 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 78617b05-5cb7-41ca-9085-a1308f65ac56 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
41962024-12-20T21:34:15.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41972024-12-20T21:34:15.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41982024-12-20T21:34:15.837ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
41992024-12-20T21:34:15.837ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
42002024-12-20T21:34:15.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42012024-12-20T21:34:15.846ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42022024-12-20T21:34:15.846ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42032024-12-20T21:34:15.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42042024-12-20T21:34:15.859ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
42052024-12-20T21:34:15.859ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
42062024-12-20T21:34:15.874ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42072024-12-20T21:34:15.876ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
42082024-12-20T21:34:15.876ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
42092024-12-20T21:34:15.876ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42102024-12-20T21:34:15.876ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42112024-12-20T21:34:15.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42122024-12-20T21:34:15.890ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
42132024-12-20T21:34:15.890ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
42142024-12-20T21:34:15.901ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = ChainSuccessorSaga
42152024-12-20T21:34:15.901ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = ChainSuccessorSaga
42162024-12-20T21:34:15.903ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = ChainSuccessorSaga
42172024-12-20T21:34:15.903ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = ChainSuccessorSaga
42182024-12-20T21:34:15.932ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = ChainSuccessorSaga
42192024-12-20T21:34:15.932ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = ChainSuccessorSaga
42202024-12-20T21:34:15.934ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = ChainSuccessorSaga
42212024-12-20T21:34:15.937ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 66e8bce1-b95a-4433-886f-e35fda6d9a14, lookup_type: ById(66e8bce1-b95a-4433-886f-e35fda6d9a14) }, key: 40304ee1-a5ea-4982-8a07-932d1d13f50e, lookup_type: ById(40304ee1-a5ea-4982-8a07-932d1d13f50e) }, key: 4e1d5d1c-803b-4f76-ae75-2577f45db478, lookup_type: ById(4e1d5d1c-803b-4f76-ae75-2577f45db478) } result = Ok(()) saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = ChainSuccessorSaga
42222024-12-20T21:34:15.937ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = ChainSuccessorSaga
42232024-12-20T21:34:15.937ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_node = ChainSuccessorSaga
42242024-12-20T21:34:15.942ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 karmic_state = WillReincarnate needs_reincarnation = false saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update
42252024-12-20T21:34:15.942ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
42262024-12-20T21:34:15.942ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
42272024-12-20T21:34:15.951ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
42282024-12-20T21:34:15.951ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
42292024-12-20T21:34:15.969ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
42302024-12-20T21:34:15.970ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ebb5c9b-432a-4c5e-bd42-d8418fcb6b98", "content-length": "691", "date": "Fri, 20 Dec 2024 21:34:15 GMT"} })
42312024-12-20T21:34:15.970ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
42322024-12-20T21:34:15.970ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
42332024-12-20T21:34:15.970ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
42342024-12-20T21:34:15.972ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 320.983117ms iteration = 25 status = {}
42352024-12-20T21:34:15.977ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
42362024-12-20T21:34:15.977ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
42372024-12-20T21:34:15.981ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
42382024-12-20T21:34:15.981ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99
42392024-12-20T21:34:16.038ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
42402024-12-20T21:34:16.038ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 saga_name = instance-update saga_result = SagaResult { saga_id: 40a3ca7a-3907-4e49-ad1d-8846cee94e99, saga_log: SagaLog { saga_id: 40a3ca7a-3907-4e49-ad1d-8846cee94e99, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("8ae6b7eb-9947-4b6b-9bfb-f032ced4e535")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("8ae6b7eb-9947-4b6b-9bfb-f032ced4e535")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("4e1d5d1c-803b-4f76-ae75-2577f45db478"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("f6bad467-a635-4e8a-b9bc-5d0c877ff60c")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("4e1d5d1c-803b-4f76-ae75-2577f45db478"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("f6bad467-a635-4e8a-b9bc-5d0c877ff60c")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("8ae6b7eb-9947-4b6b-9bfb-f032ced4e535"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("8ae6b7eb-9947-4b6b-9bfb-f032ced4e535")}} }) }
42412024-12-20T21:34:16.038ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 40a3ca7a-3907-4e49-ad1d-8846cee94e99 instance_id = 4e1d5d1c-803b-4f76-ae75-2577f45db478 saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update
42422024-12-20T21:34:16.038ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
42432024-12-20T21:34:16.038ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae
42442024-12-20T21:34:16.064ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
42452024-12-20T21:34:16.064ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae
42462024-12-20T21:34:16.078ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
42472024-12-20T21:34:16.078ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae
42482024-12-20T21:34:16.089ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
42492024-12-20T21:34:16.089ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae
42502024-12-20T21:34:16.132ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update sec_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
42512024-12-20T21:34:16.132ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 34b70aa2-a52c-41e5-a207-875170f66cae saga_name = start-instance-update saga_result = SagaResult { saga_id: 34b70aa2-a52c-41e5-a207-875170f66cae, saga_log: SagaLog { saga_id: 34b70aa2-a52c-41e5-a207-875170f66cae, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("770d8271-424f-4a54-bb76-553ff8258dda")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("770d8271-424f-4a54-bb76-553ff8258dda")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("770d8271-424f-4a54-bb76-553ff8258dda"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("770d8271-424f-4a54-bb76-553ff8258dda")}} }) }
42522024-12-20T21:34:16.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0c6eea74-b6af-44a7-a42f-20fb9096e329 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
42532024-12-20T21:34:16.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0c6eea74-b6af-44a7-a42f-20fb9096e329 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
42542024-12-20T21:34:16.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2793 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0c6eea74-b6af-44a7-a42f-20fb9096e329 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
42552024-12-20T21:34:16.406ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 664 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 0aa335ee-a21d-4d41-aae8-d68a520bd213 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
42562024-12-20T21:34:16.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = a1324f8d-c85f-4cde-ba4b-14bdb6757e3a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
42572024-12-20T21:34:16.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = a1324f8d-c85f-4cde-ba4b-14bdb6757e3a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
42582024-12-20T21:34:16.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = a1324f8d-c85f-4cde-ba4b-14bdb6757e3a response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
42592024-12-20T21:34:17.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ac2e8025-99af-41b9-84a8-bbcf21e931e1 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
42602024-12-20T21:34:17.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ac2e8025-99af-41b9-84a8-bbcf21e931e1 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
42612024-12-20T21:34:17.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1918 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ac2e8025-99af-41b9-84a8-bbcf21e931e1 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
42622024-12-20T21:34:18.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 158921b7-76d3-43d2-8bd8-d7ac1548beee roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
42632024-12-20T21:34:18.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 158921b7-76d3-43d2-8bd8-d7ac1548beee resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
42642024-12-20T21:34:18.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 158921b7-76d3-43d2-8bd8-d7ac1548beee response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
42652024-12-20T21:34:19.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 912298bb-6b32-4a47-821f-3192ad2bb3a1 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
42662024-12-20T21:34:19.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 912298bb-6b32-4a47-821f-3192ad2bb3a1 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
42672024-12-20T21:34:19.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2674 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 912298bb-6b32-4a47-821f-3192ad2bb3a1 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
42682024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
42692024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
42702024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
42712024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
42722024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42732024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42742024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42752024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
42762024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
42772024-12-20T21:34:19.540ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
42782024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42792024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
42802024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
42812024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42822024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42832024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
42842024-12-20T21:34:19.540ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9112287e-7109-46ca-aa8a-610048d83c82
42852024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.45\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"9112287e-7109-46ca-aa8a-610048d83c82"}
42862024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
42872024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
42882024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
42892024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42902024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
42912024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
42922024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42932024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42942024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
42952024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42962024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
42972024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
42982024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
42992024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
43002024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43012024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
43022024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
43032024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43042024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
43052024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43062024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
43072024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43082024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
43092024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
43102024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
43112024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
43122024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
43132024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
43142024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43152024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
43162024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
43172024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
43182024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43192024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
43202024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43212024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
43222024-12-20T21:34:19.540ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 21:24:19.540652710 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
43232024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
43242024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
43252024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
43262024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43272024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
43282024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43292024-12-20T21:34:19.540ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
43302024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
43312024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
43322024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
43332024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43342024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43352024-12-20T21:34:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43362024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43372024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43382024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43392024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43402024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43412024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43422024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43432024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43442024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43452024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43462024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43472024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
43482024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
43492024-12-20T21:34:19.541ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("065cea45-0eca-4287-90a0-2c3c20ec32f8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b24cb173-c3a3-4237-abe6-0e7953a415e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b24cb173-c3a3-4237-abe6-0e7953a415e5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1558, tv_nsec: 819939834 } })
43502024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43512024-12-20T21:34:19.541ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4565f09e-ee63-469d-bb6e-3ccd4abd01fe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("73abfaca-4f35-4f97-9980-1890d6dba8fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3f6b067-d10e-44b3-9f21-f8e5a96a2b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3f6b067-d10e-44b3-9f21-f8e5a96a2b37.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1558, tv_nsec: 819966904 } })
43522024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43532024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
43542024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43552024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43562024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43572024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
43582024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43592024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43602024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43612024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
43622024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43632024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43642024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
43652024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.256008ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
43662024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43672024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43682024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
43692024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.297099ms iteration = 13 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
43702024-12-20T21:34:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43712024-12-20T21:34:19.542ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43722024-12-20T21:34:19.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43732024-12-20T21:34:19.544ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.260226ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43742024-12-20T21:34:19.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43752024-12-20T21:34:19.545ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43762024-12-20T21:34:19.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43772024-12-20T21:34:19.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43782024-12-20T21:34:19.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43792024-12-20T21:34:19.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43802024-12-20T21:34:19.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43812024-12-20T21:34:19.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43822024-12-20T21:34:19.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43832024-12-20T21:34:19.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43842024-12-20T21:34:19.552ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43852024-12-20T21:34:19.553ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43862024-12-20T21:34:19.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43872024-12-20T21:34:19.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
43882024-12-20T21:34:19.554ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43892024-12-20T21:34:19.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43902024-12-20T21:34:19.557ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43912024-12-20T21:34:19.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43922024-12-20T21:34:19.558ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1558, tv_nsec: 837474247 } })
43932024-12-20T21:34:19.559ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
43942024-12-20T21:34:19.561ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1558, tv_nsec: 840125906 } })
43952024-12-20T21:34:19.561ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
43962024-12-20T21:34:19.563ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.689008ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
43972024-12-20T21:34:19.564ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 21:24:19.540652710 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
43982024-12-20T21:34:19.564ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 24.273775ms iteration = 13 status = {"expiration":"2024-12-20T21:24:19.540652710Z","pruned":[]}
43992024-12-20T21:34:19.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44002024-12-20T21:34:19.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44012024-12-20T21:34:19.576ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44022024-12-20T21:34:19.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44032024-12-20T21:34:19.579ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44042024-12-20T21:34:19.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44052024-12-20T21:34:19.583ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44062024-12-20T21:34:19.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44072024-12-20T21:34:19.590ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44082024-12-20T21:34:19.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44092024-12-20T21:34:19.591ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
44102024-12-20T21:34:19.591ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 51.626267ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
44112024-12-20T21:34:19.593ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44122024-12-20T21:34:19.593ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44132024-12-20T21:34:19.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44142024-12-20T21:34:19.593ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44152024-12-20T21:34:19.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
44162024-12-20T21:34:19.594ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44172024-12-20T21:34:19.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44182024-12-20T21:34:19.596ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44192024-12-20T21:34:19.596ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44202024-12-20T21:34:19.596ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
44212024-12-20T21:34:19.596ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44222024-12-20T21:34:19.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44232024-12-20T21:34:19.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44242024-12-20T21:34:19.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44252024-12-20T21:34:19.596ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44262024-12-20T21:34:19.597ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44272024-12-20T21:34:19.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44282024-12-20T21:34:19.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44292024-12-20T21:34:19.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44302024-12-20T21:34:19.598ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44312024-12-20T21:34:19.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44322024-12-20T21:34:19.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44332024-12-20T21:34:19.601ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44342024-12-20T21:34:19.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.220123ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
44352024-12-20T21:34:19.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44362024-12-20T21:34:19.603ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44372024-12-20T21:34:19.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44382024-12-20T21:34:19.603ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44392024-12-20T21:34:19.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44402024-12-20T21:34:19.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44412024-12-20T21:34:19.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44422024-12-20T21:34:19.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
44432024-12-20T21:34:19.606ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44442024-12-20T21:34:19.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44452024-12-20T21:34:19.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44462024-12-20T21:34:19.607ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44472024-12-20T21:34:19.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44482024-12-20T21:34:19.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 67.056134ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
44492024-12-20T21:34:19.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44502024-12-20T21:34:19.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44512024-12-20T21:34:19.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44522024-12-20T21:34:19.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44532024-12-20T21:34:19.608ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
44542024-12-20T21:34:19.608ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
44552024-12-20T21:34:19.608ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 67.865232ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
44562024-12-20T21:34:19.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
44572024-12-20T21:34:19.608ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
44582024-12-20T21:34:19.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
44592024-12-20T21:34:19.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44602024-12-20T21:34:19.608ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44612024-12-20T21:34:19.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44622024-12-20T21:34:19.609ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44632024-12-20T21:34:19.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44642024-12-20T21:34:19.610ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44652024-12-20T21:34:19.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44662024-12-20T21:34:19.610ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44672024-12-20T21:34:19.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44682024-12-20T21:34:19.612ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44692024-12-20T21:34:19.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44702024-12-20T21:34:19.612ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44712024-12-20T21:34:19.612ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44722024-12-20T21:34:19.612ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44732024-12-20T21:34:19.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44742024-12-20T21:34:19.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44752024-12-20T21:34:19.613ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44762024-12-20T21:34:19.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44772024-12-20T21:34:19.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
44782024-12-20T21:34:19.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44792024-12-20T21:34:19.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44802024-12-20T21:34:19.616ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1558, tv_nsec: 895539969 } })
44812024-12-20T21:34:19.617ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
44822024-12-20T21:34:19.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44832024-12-20T21:34:19.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44842024-12-20T21:34:19.628ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 87.660786ms iteration = 6 status = {"nsuccess":5}
44852024-12-20T21:34:19.639ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
44862024-12-20T21:34:19.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
44872024-12-20T21:34:19.641ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44882024-12-20T21:34:19.641ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
44892024-12-20T21:34:19.641ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 101.145688ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
44902024-12-20T21:34:19.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44912024-12-20T21:34:19.645ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
44922024-12-20T21:34:19.645ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
44932024-12-20T21:34:19.645ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
44942024-12-20T21:34:19.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44952024-12-20T21:34:19.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44962024-12-20T21:34:19.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44972024-12-20T21:34:19.651ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 111.270295ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44982024-12-20T21:34:19.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44992024-12-20T21:34:19.654ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45002024-12-20T21:34:19.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45012024-12-20T21:34:19.654ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
45022024-12-20T21:34:19.654ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
45032024-12-20T21:34:19.654ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
45042024-12-20T21:34:19.654ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45052024-12-20T21:34:19.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45062024-12-20T21:34:19.656ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
45072024-12-20T21:34:19.656ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45082024-12-20T21:34:19.657ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45092024-12-20T21:34:19.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45102024-12-20T21:34:19.658ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 118.342084ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45112024-12-20T21:34:19.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45122024-12-20T21:34:19.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45132024-12-20T21:34:19.660ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 119.875457ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45142024-12-20T21:34:19.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45152024-12-20T21:34:19.661ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45162024-12-20T21:34:19.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45172024-12-20T21:34:19.662ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45182024-12-20T21:34:19.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c74ff24-982c-40fd-86fd-ef04898c5922, lookup_type: ById(8c74ff24-982c-40fd-86fd-ef04898c5922) } result = Ok(())
45192024-12-20T21:34:19.664ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45202024-12-20T21:34:19.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45212024-12-20T21:34:19.665ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
45222024-12-20T21:34:19.665ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
45232024-12-20T21:34:19.665ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 124.474652ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
45242024-12-20T21:34:19.666ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
45252024-12-20T21:34:19.666ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 125.74978ms iteration = 25 status = 0
45262024-12-20T21:34:19.674ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45272024-12-20T21:34:19.678ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 138.364392ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
45282024-12-20T21:34:19.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
45292024-12-20T21:34:19.679ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45302024-12-20T21:34:19.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45312024-12-20T21:34:19.682ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45322024-12-20T21:34:19.682ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
45332024-12-20T21:34:19.682ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 141.524034ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
45342024-12-20T21:34:19.684ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
45352024-12-20T21:34:19.684ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c58feff7-51f2-445e-83fd-a0c3a102f4ed dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
45362024-12-20T21:34:19.684ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45372024-12-20T21:34:19.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45382024-12-20T21:34:19.686ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45392024-12-20T21:34:19.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45402024-12-20T21:34:19.692ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
45412024-12-20T21:34:19.692ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4aec9cd8-ad86-40dc-bdd7-2394e3237b38 dns_zone_name = oxide.test found_so_far = 0 version = 2
45422024-12-20T21:34:19.692ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45432024-12-20T21:34:19.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45442024-12-20T21:34:19.697ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45452024-12-20T21:34:19.697ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45462024-12-20T21:34:19.697ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "db044cff-f34d-41eb-a6be-d9d6db0a0b73", "content-length": "26", "date": "Fri, 20 Dec 2024 21:34:18 GMT"} })
45472024-12-20T21:34:19.697ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45482024-12-20T21:34:19.699ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45492024-12-20T21:34:19.705ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45502024-12-20T21:34:19.705ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45512024-12-20T21:34:19.705ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cba6a662-880f-4f9f-bca5-8e68217eb131", "content-length": "26", "date": "Fri, 20 Dec 2024 21:34:18 GMT"} })
45522024-12-20T21:34:19.705ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45532024-12-20T21:34:19.707ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45542024-12-20T21:34:19.714ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45552024-12-20T21:34:19.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45562024-12-20T21:34:19.714ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 174.597455ms iteration = 28 status = {"physical_disks_added":0}
45572024-12-20T21:34:19.739ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
45582024-12-20T21:34:19.739ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 199.284468ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
45592024-12-20T21:34:19.826ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
45602024-12-20T21:34:19.826ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "bdd76d3a-abad-43c3-8cc6-4a1ffe3b0596", "date": "Fri, 20 Dec 2024 21:34:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45612024-12-20T21:34:19.826ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45622024-12-20T21:34:19.828ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "16ded021-12a6-47e7-9d95-0e4474c1d950", "date": "Fri, 20 Dec 2024 21:34:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45632024-12-20T21:34:19.828ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45642024-12-20T21:34:19.829ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45652024-12-20T21:34:19.829ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 289.38822ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
45662024-12-20T21:34:19.830ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
45672024-12-20T21:34:19.851ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
45682024-12-20T21:34:19.851ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d81ea9d9-3312-47e5-ac70-8f2c3cb939d4", "content-length": "2", "date": "Fri, 20 Dec 2024 21:34:19 GMT"} })
45692024-12-20T21:34:19.853ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45702024-12-20T21:34:19.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45712024-12-20T21:34:19.914ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac zone_address = fd00:1122:3344:101::2
45722024-12-20T21:34:19.914ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45732024-12-20T21:34:19.914ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1582823a-7451-42eb-b507-4d8fea56d30a", "content-length": "26", "date": "Fri, 20 Dec 2024 21:34:19 GMT"} })
45742024-12-20T21:34:19.914ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45752024-12-20T21:34:19.916ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
45762024-12-20T21:34:19.954ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
45772024-12-20T21:34:19.955ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a78574d2-0f74-4709-949d-f1d5ae97ab2c", "date": "Fri, 20 Dec 2024 21:34:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
45782024-12-20T21:34:19.955ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
45792024-12-20T21:34:19.956ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "30b06d28-d78d-40bf-825d-feec0c1fddb1", "date": "Fri, 20 Dec 2024 21:34:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
45802024-12-20T21:34:19.956ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
45812024-12-20T21:34:19.958ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "47ba896d-6dd8-4bbd-b4ad-499c4eff5e33", "date": "Fri, 20 Dec 2024 21:34:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
45822024-12-20T21:34:19.958ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
45832024-12-20T21:34:19.960ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
45842024-12-20T21:34:19.960ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 420.256333ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
45852024-12-20T21:34:19.989ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45862024-12-20T21:34:19.989ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45872024-12-20T21:34:19.989ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6ae5715-7681-4c2f-ad53-602d6b479a06", "content-length": "372", "date": "Fri, 20 Dec 2024 21:34:19 GMT"} })
45882024-12-20T21:34:19.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45892024-12-20T21:34:19.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45902024-12-20T21:34:19.995ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45912024-12-20T21:34:19.996ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45922024-12-20T21:34:19.997ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45932024-12-20T21:34:19.999ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
45942024-12-20T21:34:20.000ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45952024-12-20T21:34:20.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45962024-12-20T21:34:20.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45972024-12-20T21:34:20.000ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45982024-12-20T21:34:20.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45992024-12-20T21:34:20.000ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46002024-12-20T21:34:20.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46012024-12-20T21:34:20.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46022024-12-20T21:34:20.001ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 460.989216ms iteration = 25 status = {}
46032024-12-20T21:34:20.003ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 462.487099ms iteration = 25 status = null
46042024-12-20T21:34:20.004ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4aec9cd8-ad86-40dc-bdd7-2394e3237b38 dns_zone_name = oxide.test found_so_far = 1 version = 2
46052024-12-20T21:34:20.004ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c58feff7-51f2-445e-83fd-a0c3a102f4ed dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
46062024-12-20T21:34:20.004ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
46072024-12-20T21:34:20.004ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 21:23:05.526309 UTC dns_group = external generation = 2
46082024-12-20T21:34:20.004ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 464.217749ms iteration = 13 status = {"generation":2}
46092024-12-20T21:34:20.004ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
46102024-12-20T21:34:20.004ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 21:23:04.517297 UTC dns_group = internal generation = 1
46112024-12-20T21:34:20.004ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 464.302391ms iteration = 13 status = {"generation":1}
46122024-12-20T21:34:20.005ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46132024-12-20T21:34:20.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46142024-12-20T21:34:20.006ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46152024-12-20T21:34:20.008ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46162024-12-20T21:34:20.008ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46172024-12-20T21:34:20.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46182024-12-20T21:34:20.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46192024-12-20T21:34:20.017ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46202024-12-20T21:34:20.017ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46212024-12-20T21:34:20.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46222024-12-20T21:34:20.048ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T21:22:10.640928Z, time_modified: 2024-12-20T21:22:10.640928Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, db_silo: Silo { identity: SiloIdentity { id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T21:23:05.471312Z, time_modified: 2024-12-20T21:23:05.471312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, db_silo: Silo { identity: SiloIdentity { id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T21:23:05.471312Z, time_modified: 2024-12-20T21:23:05.471312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
46232024-12-20T21:34:20.048ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 508.130264ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"66e8bce1-b95a-4433-886f-e35fda6d9a14","tls_certs":["4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b"]}},"default_endpoint":{"silo_id":"66e8bce1-b95a-4433-886f-e35fda6d9a14","tls_certs":["4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
46242024-12-20T21:34:20.058ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
46252024-12-20T21:34:20.058ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46262024-12-20T21:34:20.058ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "975fd718-030b-451f-99b0-4900d11bb8d2", "date": "Fri, 20 Dec 2024 21:34:19 GMT"} })
46272024-12-20T21:34:20.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46282024-12-20T21:34:20.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46292024-12-20T21:34:20.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46302024-12-20T21:34:20.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46312024-12-20T21:34:20.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46322024-12-20T21:34:20.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46332024-12-20T21:34:20.068ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
46342024-12-20T21:34:20.068ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46352024-12-20T21:34:20.068ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "59a5500c-289d-47f1-8f5c-7192555ddca7", "date": "Fri, 20 Dec 2024 21:34:19 GMT"} })
46362024-12-20T21:34:20.070ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 530.580687ms iteration = 26 status = {}
46372024-12-20T21:34:20.077ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46382024-12-20T21:34:20.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46392024-12-20T21:34:20.079ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 583388f4-92af-4a10-817c-62f2e9571310, rack_id: a7e68df9-95f5-4fda-aae0-2f46483e29ac, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bacaa666-9eda-4bc8-9ccd-35df228fd476) } rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
46402024-12-20T21:34:20.079ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46412024-12-20T21:34:20.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46422024-12-20T21:34:20.088ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46432024-12-20T21:34:20.088ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f42ef83-6959-43de-862b-887181348fca", "content-length": "134", "date": "Fri, 20 Dec 2024 21:34:20 GMT"} })
46442024-12-20T21:34:20.089ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
46452024-12-20T21:34:20.089ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bacaa666-9eda-4bc8-9ccd-35df228fd476
46462024-12-20T21:34:20.089ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46472024-12-20T21:34:20.089ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46482024-12-20T21:34:20.089ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46492024-12-20T21:34:20.089ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46502024-12-20T21:34:20.089ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46512024-12-20T21:34:20.089ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46522024-12-20T21:34:20.089ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46532024-12-20T21:34:20.089ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46542024-12-20T21:34:20.089ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
46552024-12-20T21:34:20.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46562024-12-20T21:34:20.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46572024-12-20T21:34:20.092ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46582024-12-20T21:34:20.092ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb93ca6a-5331-46f5-82b4-b2d33e8fda63", "content-length": "2", "date": "Fri, 20 Dec 2024 21:34:20 GMT"} })
46592024-12-20T21:34:20.092ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46602024-12-20T21:34:20.092ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "53dd32ea-270b-4ad5-a162-bbe1a0f354ab", "content-length": "52", "date": "Fri, 20 Dec 2024 21:34:20 GMT"} })
46612024-12-20T21:34:20.092ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
46622024-12-20T21:34:20.092ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46632024-12-20T21:34:20.114ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46642024-12-20T21:34:20.190ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fa7b08e7-c0be-453a-9e39-ecec19d5bada", "date": "Fri, 20 Dec 2024 21:34:19 GMT"} })
46652024-12-20T21:34:20.191ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch = Switch0
46662024-12-20T21:34:20.191ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46672024-12-20T21:34:20.191ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1315be7a-52c1-4db0-889f-126b0c494134", "content-length": "682", "date": "Fri, 20 Dec 2024 21:34:19 GMT"} })
46682024-12-20T21:34:20.191ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46692024-12-20T21:34:20.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46702024-12-20T21:34:20.191ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4737d0d2-5763-44e4-94d7-b0b6086110e6", "content-length": "691", "date": "Fri, 20 Dec 2024 21:34:20 GMT"} })
46712024-12-20T21:34:20.191ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
46722024-12-20T21:34:20.191ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
46732024-12-20T21:34:20.191ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
46742024-12-20T21:34:20.193ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 652.859859ms iteration = 26 status = {}
46752024-12-20T21:34:20.195ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46762024-12-20T21:34:20.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46772024-12-20T21:34:20.199ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46782024-12-20T21:34:20.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46792024-12-20T21:34:20.201ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46802024-12-20T21:34:20.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46812024-12-20T21:34:20.209ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 668.762255ms iteration = 25 status = {}
46822024-12-20T21:34:20.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 225c1b24-0144-4439-9b1b-44106c75561d roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
46832024-12-20T21:34:20.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 225c1b24-0144-4439-9b1b-44106c75561d resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
46842024-12-20T21:34:20.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 225c1b24-0144-4439-9b1b-44106c75561d response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
46852024-12-20T21:34:21.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c4c69dfb-b8c0-4c51-a8de-49cca3b93bf4 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
46862024-12-20T21:34:21.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c4c69dfb-b8c0-4c51-a8de-49cca3b93bf4 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
46872024-12-20T21:34:21.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c4c69dfb-b8c0-4c51-a8de-49cca3b93bf4 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
46882024-12-20T21:34:22.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c2278747-1c1b-43f8-9dd9-20b94efa70ac roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
46892024-12-20T21:34:22.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c2278747-1c1b-43f8-9dd9-20b94efa70ac resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
46902024-12-20T21:34:22.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c2278747-1c1b-43f8-9dd9-20b94efa70ac response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
46912024-12-20T21:34:23.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d51fadfe-1d24-4bb6-8f8c-9b873f67db6f roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
46922024-12-20T21:34:23.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d51fadfe-1d24-4bb6-8f8c-9b873f67db6f resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
46932024-12-20T21:34:23.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d51fadfe-1d24-4bb6-8f8c-9b873f67db6f response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
46942024-12-20T21:34:24.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 126e1f8f-436a-4c14-841a-56c6cc57c8e6 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
46952024-12-20T21:34:24.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 126e1f8f-436a-4c14-841a-56c6cc57c8e6 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
46962024-12-20T21:34:24.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2816 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 126e1f8f-436a-4c14-841a-56c6cc57c8e6 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
46972024-12-20T21:34:25.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 36c0fb4b-acba-499d-bad9-6709826a2fbe roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
46982024-12-20T21:34:25.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 36c0fb4b-acba-499d-bad9-6709826a2fbe resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
46992024-12-20T21:34:25.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 36c0fb4b-acba-499d-bad9-6709826a2fbe response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47002024-12-20T21:34:26.406ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 602 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 13c14004-cde6-4ad3-8205-342e15b77b76 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
47012024-12-20T21:34:26.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9f87aec5-aded-46bb-8334-94925ad426bb roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47022024-12-20T21:34:26.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9f87aec5-aded-46bb-8334-94925ad426bb resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47032024-12-20T21:34:26.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9f87aec5-aded-46bb-8334-94925ad426bb response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47042024-12-20T21:34:27.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9fc5d9a5-d4c1-401f-aefe-9b32782c9970 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47052024-12-20T21:34:27.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9fc5d9a5-d4c1-401f-aefe-9b32782c9970 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47062024-12-20T21:34:27.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9fc5d9a5-d4c1-401f-aefe-9b32782c9970 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47072024-12-20T21:34:28.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 134d286c-0717-4b30-ba4e-47f7971e7b2e roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47082024-12-20T21:34:28.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 134d286c-0717-4b30-ba4e-47f7971e7b2e resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47092024-12-20T21:34:28.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2652 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 134d286c-0717-4b30-ba4e-47f7971e7b2e response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47102024-12-20T21:34:29.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = dc9416d0-a53f-491b-bf36-173ce97c5ced roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47112024-12-20T21:34:29.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = dc9416d0-a53f-491b-bf36-173ce97c5ced resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47122024-12-20T21:34:29.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = dc9416d0-a53f-491b-bf36-173ce97c5ced response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47132024-12-20T21:34:29.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
47142024-12-20T21:34:29.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
47152024-12-20T21:34:29.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47162024-12-20T21:34:29.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47172024-12-20T21:34:29.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47182024-12-20T21:34:29.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47192024-12-20T21:34:29.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47202024-12-20T21:34:29.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47212024-12-20T21:34:29.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47222024-12-20T21:34:29.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47232024-12-20T21:34:29.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47242024-12-20T21:34:29.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47252024-12-20T21:34:29.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.013743ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47262024-12-20T21:34:29.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47272024-12-20T21:34:29.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47282024-12-20T21:34:29.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47292024-12-20T21:34:29.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
47302024-12-20T21:34:29.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47312024-12-20T21:34:29.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47322024-12-20T21:34:29.562ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
47332024-12-20T21:34:29.562ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.813412ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
47342024-12-20T21:34:30.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1e02890b-bab5-4cb8-a849-000b32aad911 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47352024-12-20T21:34:30.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1e02890b-bab5-4cb8-a849-000b32aad911 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47362024-12-20T21:34:30.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1743 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1e02890b-bab5-4cb8-a849-000b32aad911 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47372024-12-20T21:34:31.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fcf85cf9-0c36-4b1b-ba93-07a6e74f24e2 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47382024-12-20T21:34:31.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fcf85cf9-0c36-4b1b-ba93-07a6e74f24e2 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47392024-12-20T21:34:31.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2763 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fcf85cf9-0c36-4b1b-ba93-07a6e74f24e2 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47402024-12-20T21:34:32.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d33ebd0b-daa0-41e7-af98-5e807b4e9472 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47412024-12-20T21:34:32.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d33ebd0b-daa0-41e7-af98-5e807b4e9472 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47422024-12-20T21:34:32.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2026 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d33ebd0b-daa0-41e7-af98-5e807b4e9472 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47432024-12-20T21:34:33.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1d24d113-91a3-4107-a2dd-1935e40bb595 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47442024-12-20T21:34:33.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1d24d113-91a3-4107-a2dd-1935e40bb595 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47452024-12-20T21:34:33.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2628 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1d24d113-91a3-4107-a2dd-1935e40bb595 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47462024-12-20T21:34:34.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ff18b754-8a4d-4080-a064-c91046051ac9 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47472024-12-20T21:34:34.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ff18b754-8a4d-4080-a064-c91046051ac9 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47482024-12-20T21:34:34.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2494 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ff18b754-8a4d-4080-a064-c91046051ac9 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47492024-12-20T21:34:35.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bbd461b2-8975-4509-b8bb-2104b3b78aa6 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47502024-12-20T21:34:35.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bbd461b2-8975-4509-b8bb-2104b3b78aa6 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47512024-12-20T21:34:35.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bbd461b2-8975-4509-b8bb-2104b3b78aa6 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47522024-12-20T21:34:36.406ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 766 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 2f80622b-e011-46a3-b9a7-f4d606bee46b response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
47532024-12-20T21:34:36.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a9f96a73-2e70-4ded-9992-6d0d6dc89891 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47542024-12-20T21:34:36.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a9f96a73-2e70-4ded-9992-6d0d6dc89891 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47552024-12-20T21:34:36.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a9f96a73-2e70-4ded-9992-6d0d6dc89891 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47562024-12-20T21:34:37.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 568d7cbd-492f-4e52-a4cd-b8ca129b6ab4 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47572024-12-20T21:34:37.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 568d7cbd-492f-4e52-a4cd-b8ca129b6ab4 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47582024-12-20T21:34:37.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 568d7cbd-492f-4e52-a4cd-b8ca129b6ab4 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47592024-12-20T21:34:38.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 63105c1a-f199-446c-8ad9-c1d716e7ea46 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47602024-12-20T21:34:38.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 63105c1a-f199-446c-8ad9-c1d716e7ea46 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47612024-12-20T21:34:38.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 63105c1a-f199-446c-8ad9-c1d716e7ea46 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47622024-12-20T21:34:39.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
47632024-12-20T21:34:39.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
47642024-12-20T21:34:39.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47652024-12-20T21:34:39.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47662024-12-20T21:34:39.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47672024-12-20T21:34:39.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47682024-12-20T21:34:39.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47692024-12-20T21:34:39.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47702024-12-20T21:34:39.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47712024-12-20T21:34:39.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.43355ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47722024-12-20T21:34:39.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47732024-12-20T21:34:39.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47742024-12-20T21:34:39.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47752024-12-20T21:34:39.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47762024-12-20T21:34:39.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47772024-12-20T21:34:39.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47782024-12-20T21:34:39.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
47792024-12-20T21:34:39.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47802024-12-20T21:34:39.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47812024-12-20T21:34:39.559ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
47822024-12-20T21:34:39.559ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.234031ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
47832024-12-20T21:34:39.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 21ece9b7-3708-4c92-9f50-d5b34236f9eb roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47842024-12-20T21:34:39.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 21ece9b7-3708-4c92-9f50-d5b34236f9eb resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47852024-12-20T21:34:39.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 21ece9b7-3708-4c92-9f50-d5b34236f9eb response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47862024-12-20T21:34:40.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b9882bbc-3c44-43db-b7ed-76dc6c8a057f roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47872024-12-20T21:34:40.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b9882bbc-3c44-43db-b7ed-76dc6c8a057f resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47882024-12-20T21:34:40.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b9882bbc-3c44-43db-b7ed-76dc6c8a057f response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47892024-12-20T21:34:41.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fe7beb56-32ff-4907-979d-73e8d280a44b roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47902024-12-20T21:34:41.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fe7beb56-32ff-4907-979d-73e8d280a44b resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47912024-12-20T21:34:41.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2650 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = fe7beb56-32ff-4907-979d-73e8d280a44b response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47922024-12-20T21:34:42.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ba7f24ec-9639-436d-89db-072a215612de roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47932024-12-20T21:34:42.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ba7f24ec-9639-436d-89db-072a215612de resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47942024-12-20T21:34:42.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ba7f24ec-9639-436d-89db-072a215612de response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47952024-12-20T21:34:43.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 21194f56-f9fa-4f01-adca-579df4d8a524 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47962024-12-20T21:34:43.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 21194f56-f9fa-4f01-adca-579df4d8a524 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47972024-12-20T21:34:43.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2658 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 21194f56-f9fa-4f01-adca-579df4d8a524 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47982024-12-20T21:34:44.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f6f90786-bbac-4af9-8e2a-f0a4136ccc08 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
47992024-12-20T21:34:44.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f6f90786-bbac-4af9-8e2a-f0a4136ccc08 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
48002024-12-20T21:34:44.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2464 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f6f90786-bbac-4af9-8e2a-f0a4136ccc08 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
48012024-12-20T21:34:45.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 33892fe9-be4e-4b21-8a89-44b2480005dd roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
48022024-12-20T21:34:45.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 33892fe9-be4e-4b21-8a89-44b2480005dd resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
48032024-12-20T21:34:45.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 33892fe9-be4e-4b21-8a89-44b2480005dd response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
48042024-12-20T21:34:46.406ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 619 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = c50b75ae-efab-4bdc-9cab-6be5cf62d210 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
48052024-12-20T21:34:46.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 4313590b-e4a4-4022-8b52-421f22f54676 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
48062024-12-20T21:34:46.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 4313590b-e4a4-4022-8b52-421f22f54676 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
48072024-12-20T21:34:46.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3961 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 4313590b-e4a4-4022-8b52-421f22f54676 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
48082024-12-20T21:34:46.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4bbc72aa-c68e-4d36-b6d7-05f17ff9303d roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
48092024-12-20T21:34:46.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4bbc72aa-c68e-4d36-b6d7-05f17ff9303d resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
48102024-12-20T21:34:46.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4bbc72aa-c68e-4d36-b6d7-05f17ff9303d response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
48112024-12-20T21:34:47.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6e2fa757-dd43-4f6a-9407-c0cbc87437d1 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
48122024-12-20T21:34:47.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6e2fa757-dd43-4f6a-9407-c0cbc87437d1 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
48132024-12-20T21:34:47.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6e2fa757-dd43-4f6a-9407-c0cbc87437d1 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
48142024-12-20T21:34:48.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 62be19ad-5433-47ff-bfd5-4668a553f0a3 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
48152024-12-20T21:34:48.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 62be19ad-5433-47ff-bfd5-4668a553f0a3 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
48162024-12-20T21:34:48.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1769 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 62be19ad-5433-47ff-bfd5-4668a553f0a3 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
48172024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
48182024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
48192024-12-20T21:34:49.540ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
48202024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48212024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
48222024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48232024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48242024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
48252024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
48262024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
48272024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
48282024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48292024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48302024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
48312024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48322024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
48332024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48342024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
48352024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
48362024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
48372024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48382024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
48392024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48402024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
48412024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48422024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48432024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
48442024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48452024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
48462024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48472024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
48482024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48492024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
48502024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
48512024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48522024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48532024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48542024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48552024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48562024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48572024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
48582024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
48592024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48602024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
48612024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48622024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48632024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48642024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48652024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48662024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48672024-12-20T21:34:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48682024-12-20T21:34:49.543ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1588, tv_nsec: 821759374 } })
48692024-12-20T21:34:49.543ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
48702024-12-20T21:34:49.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48712024-12-20T21:34:49.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48722024-12-20T21:34:49.544ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48732024-12-20T21:34:49.544ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.504151ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
48742024-12-20T21:34:49.546ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48752024-12-20T21:34:49.546ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48762024-12-20T21:34:49.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48772024-12-20T21:34:49.546ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1588, tv_nsec: 825227861 } })
48782024-12-20T21:34:49.546ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
48792024-12-20T21:34:49.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48802024-12-20T21:34:49.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48812024-12-20T21:34:49.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48822024-12-20T21:34:49.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48832024-12-20T21:34:49.547ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48842024-12-20T21:34:49.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48852024-12-20T21:34:49.549ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.789808ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
48862024-12-20T21:34:49.549ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48872024-12-20T21:34:49.550ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48882024-12-20T21:34:49.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48892024-12-20T21:34:49.552ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48902024-12-20T21:34:49.552ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
48912024-12-20T21:34:49.552ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48922024-12-20T21:34:49.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48932024-12-20T21:34:49.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
48942024-12-20T21:34:49.552ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48952024-12-20T21:34:49.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48962024-12-20T21:34:49.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
48972024-12-20T21:34:49.553ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48982024-12-20T21:34:49.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
48992024-12-20T21:34:49.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49002024-12-20T21:34:49.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49012024-12-20T21:34:49.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49022024-12-20T21:34:49.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49032024-12-20T21:34:49.556ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49042024-12-20T21:34:49.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49052024-12-20T21:34:49.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49062024-12-20T21:34:49.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49072024-12-20T21:34:49.557ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49082024-12-20T21:34:49.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49092024-12-20T21:34:49.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49102024-12-20T21:34:49.557ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49112024-12-20T21:34:49.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49122024-12-20T21:34:49.558ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49132024-12-20T21:34:49.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49142024-12-20T21:34:49.559ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1588, tv_nsec: 837831384 } })
49152024-12-20T21:34:49.559ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
49162024-12-20T21:34:49.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49172024-12-20T21:34:49.560ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49182024-12-20T21:34:49.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49192024-12-20T21:34:49.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
49202024-12-20T21:34:49.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49212024-12-20T21:34:49.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49222024-12-20T21:34:49.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49232024-12-20T21:34:49.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49242024-12-20T21:34:49.577ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
49252024-12-20T21:34:49.577ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 37.136863ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
49262024-12-20T21:34:49.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 41.302747ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
49272024-12-20T21:34:49.586ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49282024-12-20T21:34:49.586ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49292024-12-20T21:34:49.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49302024-12-20T21:34:49.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49312024-12-20T21:34:49.588ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49322024-12-20T21:34:49.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49332024-12-20T21:34:49.589ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49342024-12-20T21:34:49.589ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
49352024-12-20T21:34:49.589ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49362024-12-20T21:34:49.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49372024-12-20T21:34:49.591ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49382024-12-20T21:34:49.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49392024-12-20T21:34:49.594ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49402024-12-20T21:34:49.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49412024-12-20T21:34:49.596ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
49422024-12-20T21:34:49.596ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.432945ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
49432024-12-20T21:34:49.645ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
49442024-12-20T21:34:49.645ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49452024-12-20T21:34:49.645ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "23cb8827-5136-4af2-9d31-daa9c55784ba", "content-length": "26", "date": "Fri, 20 Dec 2024 21:34:48 GMT"} })
49462024-12-20T21:34:49.645ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49472024-12-20T21:34:49.646ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49482024-12-20T21:34:49.646ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
49492024-12-20T21:34:49.647ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49502024-12-20T21:34:49.647ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "528e84fd-f293-4953-a3a2-091f69998b11", "content-length": "26", "date": "Fri, 20 Dec 2024 21:34:48 GMT"} })
49512024-12-20T21:34:49.647ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49522024-12-20T21:34:49.648ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49532024-12-20T21:34:49.657ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 117.285461ms iteration = 29 status = {"physical_disks_added":0}
49542024-12-20T21:34:49.668ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac zone_address = fd00:1122:3344:101::2
49552024-12-20T21:34:49.668ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49562024-12-20T21:34:49.668ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "58d985d1-51ba-458a-82de-b18640faeb7d", "content-length": "26", "date": "Fri, 20 Dec 2024 21:34:48 GMT"} })
49572024-12-20T21:34:49.668ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49582024-12-20T21:34:49.670ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
49592024-12-20T21:34:49.670ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
49602024-12-20T21:34:49.670ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49612024-12-20T21:34:49.671ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "99556e96-45c0-46cf-96ba-6d3ee684f15a", "content-length": "372", "date": "Fri, 20 Dec 2024 21:34:49 GMT"} })
49622024-12-20T21:34:49.671ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49632024-12-20T21:34:49.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49642024-12-20T21:34:49.674ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49652024-12-20T21:34:49.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49662024-12-20T21:34:49.702ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49672024-12-20T21:34:49.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49682024-12-20T21:34:49.702ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 162.543064ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49692024-12-20T21:34:49.707ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 166.898433ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
49702024-12-20T21:34:49.707ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49712024-12-20T21:34:49.707ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
49722024-12-20T21:34:49.707ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 167.735842ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
49732024-12-20T21:34:49.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49742024-12-20T21:34:49.709ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 169.076932ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
49752024-12-20T21:34:49.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49762024-12-20T21:34:49.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49772024-12-20T21:34:49.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c74ff24-982c-40fd-86fd-ef04898c5922, lookup_type: ById(8c74ff24-982c-40fd-86fd-ef04898c5922) } result = Ok(())
49782024-12-20T21:34:49.711ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49792024-12-20T21:34:49.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49802024-12-20T21:34:49.713ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 173.779666ms iteration = 26 status = 0
49812024-12-20T21:34:49.720ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
49822024-12-20T21:34:49.720ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
49832024-12-20T21:34:49.720ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1d541353-feb8-43f4-9b3d-ac39215f1846", "date": "Fri, 20 Dec 2024 21:34:49 GMT"} })
49842024-12-20T21:34:49.720ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49852024-12-20T21:34:49.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49862024-12-20T21:34:49.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49872024-12-20T21:34:49.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49882024-12-20T21:34:49.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49892024-12-20T21:34:49.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49902024-12-20T21:34:49.729ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
49912024-12-20T21:34:49.729ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "422a29a7-8da7-4115-a68e-e6cb5aafbef3", "content-length": "2", "date": "Fri, 20 Dec 2024 21:34:48 GMT"} })
49922024-12-20T21:34:49.730ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
49932024-12-20T21:34:49.730ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49942024-12-20T21:34:49.730ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "283a8358-a964-4f46-9074-28ec2b5b435e", "date": "Fri, 20 Dec 2024 21:34:49 GMT"} })
49952024-12-20T21:34:49.731ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49962024-12-20T21:34:49.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49972024-12-20T21:34:49.732ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 192.012536ms iteration = 27 status = {}
49982024-12-20T21:34:49.732ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 192.002806ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
49992024-12-20T21:34:49.733ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 193.312715ms iteration = 26 status = null
50002024-12-20T21:34:49.739ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 199.535084ms iteration = 26 status = {}
50012024-12-20T21:34:49.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50022024-12-20T21:34:49.742ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50032024-12-20T21:34:49.742ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50042024-12-20T21:34:49.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50052024-12-20T21:34:49.770ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50062024-12-20T21:34:49.772ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50072024-12-20T21:34:49.772ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50082024-12-20T21:34:49.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50092024-12-20T21:34:49.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50102024-12-20T21:34:49.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50112024-12-20T21:34:49.807ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 583388f4-92af-4a10-817c-62f2e9571310, rack_id: a7e68df9-95f5-4fda-aae0-2f46483e29ac, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bacaa666-9eda-4bc8-9ccd-35df228fd476) } rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
50122024-12-20T21:34:49.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50132024-12-20T21:34:49.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50142024-12-20T21:34:49.817ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
50152024-12-20T21:34:49.818ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "20b580d1-ddbb-4971-b456-651c531304d4", "content-length": "134", "date": "Fri, 20 Dec 2024 21:34:49 GMT"} })
50162024-12-20T21:34:49.818ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
50172024-12-20T21:34:49.818ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bacaa666-9eda-4bc8-9ccd-35df228fd476
50182024-12-20T21:34:49.818ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
50192024-12-20T21:34:49.818ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50202024-12-20T21:34:49.818ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50212024-12-20T21:34:49.818ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50222024-12-20T21:34:49.818ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50232024-12-20T21:34:49.818ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50242024-12-20T21:34:49.818ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50252024-12-20T21:34:49.818ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50262024-12-20T21:34:49.818ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
50272024-12-20T21:34:49.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50282024-12-20T21:34:49.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50292024-12-20T21:34:49.821ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
50302024-12-20T21:34:49.821ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "92691fcb-e472-4e86-ac89-d848c72b448c", "content-length": "2", "date": "Fri, 20 Dec 2024 21:34:49 GMT"} })
50312024-12-20T21:34:49.821ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
50322024-12-20T21:34:49.821ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "84100120-91a5-435d-a318-d8cae5df51f2", "content-length": "52", "date": "Fri, 20 Dec 2024 21:34:49 GMT"} })
50332024-12-20T21:34:49.821ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
50342024-12-20T21:34:49.821ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
50352024-12-20T21:34:49.864ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50362024-12-20T21:34:49.929ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1499630e-b0fd-484c-8945-55f7e6a131ad", "date": "Fri, 20 Dec 2024 21:34:49 GMT"} })
50372024-12-20T21:34:49.929ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch = Switch0
50382024-12-20T21:34:49.929ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
50392024-12-20T21:34:49.930ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3798aa89-3025-4475-a14c-59293d8ca18b", "content-length": "682", "date": "Fri, 20 Dec 2024 21:34:49 GMT"} })
50402024-12-20T21:34:49.930ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50412024-12-20T21:34:49.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50422024-12-20T21:34:49.930ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "80bd85f5-0865-4702-adf6-38fef6853682", "content-length": "691", "date": "Fri, 20 Dec 2024 21:34:49 GMT"} })
50432024-12-20T21:34:49.930ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
50442024-12-20T21:34:49.930ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
50452024-12-20T21:34:49.930ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
50462024-12-20T21:34:49.933ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 392.931731ms iteration = 27 status = {}
50472024-12-20T21:34:49.934ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50482024-12-20T21:34:49.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50492024-12-20T21:34:49.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50502024-12-20T21:34:49.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50512024-12-20T21:34:49.941ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50522024-12-20T21:34:49.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50532024-12-20T21:34:49.948ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 408.174303ms iteration = 26 status = {}
50542024-12-20T21:34:49.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c01c2a4b-8828-4f75-acdb-1a4f13857692 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50552024-12-20T21:34:49.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c01c2a4b-8828-4f75-acdb-1a4f13857692 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50562024-12-20T21:34:49.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2634 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c01c2a4b-8828-4f75-acdb-1a4f13857692 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50572024-12-20T21:34:50.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d887646d-17c6-498a-9a5c-0ffe3942787f roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50582024-12-20T21:34:50.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d887646d-17c6-498a-9a5c-0ffe3942787f resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50592024-12-20T21:34:50.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d887646d-17c6-498a-9a5c-0ffe3942787f response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50602024-12-20T21:34:52.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6aa860a1-1aca-43c5-8ba2-fca2c20a1ab0 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50612024-12-20T21:34:52.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6aa860a1-1aca-43c5-8ba2-fca2c20a1ab0 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50622024-12-20T21:34:52.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2747 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6aa860a1-1aca-43c5-8ba2-fca2c20a1ab0 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50632024-12-20T21:34:53.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 64c65267-40b1-452b-8d86-d5097c85b883 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50642024-12-20T21:34:53.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 64c65267-40b1-452b-8d86-d5097c85b883 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50652024-12-20T21:34:53.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2798 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 64c65267-40b1-452b-8d86-d5097c85b883 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50662024-12-20T21:34:54.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6967643b-f640-4409-9911-0fc68e4a5425 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50672024-12-20T21:34:54.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6967643b-f640-4409-9911-0fc68e4a5425 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50682024-12-20T21:34:54.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2577 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6967643b-f640-4409-9911-0fc68e4a5425 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50692024-12-20T21:34:55.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0a737586-c30a-4b02-88ed-83c6c2ebcba9 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50702024-12-20T21:34:55.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0a737586-c30a-4b02-88ed-83c6c2ebcba9 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50712024-12-20T21:34:55.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0a737586-c30a-4b02-88ed-83c6c2ebcba9 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50722024-12-20T21:34:56.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8f74e209-95c9-485c-8687-1e2066c49ed8 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50732024-12-20T21:34:56.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8f74e209-95c9-485c-8687-1e2066c49ed8 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50742024-12-20T21:34:56.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8f74e209-95c9-485c-8687-1e2066c49ed8 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50752024-12-20T21:34:56.406ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 558 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 2f5ac0b0-10c9-4e33-b976-67b2531b2603 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
50762024-12-20T21:34:57.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0d81a668-1d12-44c4-9b40-8146f18195f2 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50772024-12-20T21:34:57.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0d81a668-1d12-44c4-9b40-8146f18195f2 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50782024-12-20T21:34:57.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0d81a668-1d12-44c4-9b40-8146f18195f2 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50792024-12-20T21:34:58.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 543a5787-42e7-4696-820c-bc2891798d65 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50802024-12-20T21:34:58.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 543a5787-42e7-4696-820c-bc2891798d65 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50812024-12-20T21:34:58.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2628 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 543a5787-42e7-4696-820c-bc2891798d65 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50822024-12-20T21:34:59.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 44f90baf-6e05-49be-9507-d2fa74537534 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50832024-12-20T21:34:59.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 44f90baf-6e05-49be-9507-d2fa74537534 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50842024-12-20T21:34:59.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 44f90baf-6e05-49be-9507-d2fa74537534 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
50852024-12-20T21:34:59.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
50862024-12-20T21:34:59.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50872024-12-20T21:34:59.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
50882024-12-20T21:34:59.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50892024-12-20T21:34:59.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50902024-12-20T21:34:59.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50912024-12-20T21:34:59.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50922024-12-20T21:34:59.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50932024-12-20T21:34:59.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50942024-12-20T21:34:59.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50952024-12-20T21:34:59.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50962024-12-20T21:34:59.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50972024-12-20T21:34:59.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50982024-12-20T21:34:59.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50992024-12-20T21:34:59.573ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.538052ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51002024-12-20T21:34:59.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51012024-12-20T21:34:59.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
51022024-12-20T21:34:59.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51032024-12-20T21:34:59.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51042024-12-20T21:34:59.588ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
51052024-12-20T21:34:59.588ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.540139ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
51062024-12-20T21:35:00.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a1e97564-4a33-4137-807a-2140054e64f6 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51072024-12-20T21:35:00.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a1e97564-4a33-4137-807a-2140054e64f6 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51082024-12-20T21:35:00.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2593 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a1e97564-4a33-4137-807a-2140054e64f6 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51092024-12-20T21:35:01.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 55a5a4f0-37c4-4ee8-9f47-25b97830f8b6 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51102024-12-20T21:35:01.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 55a5a4f0-37c4-4ee8-9f47-25b97830f8b6 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51112024-12-20T21:35:01.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 55a5a4f0-37c4-4ee8-9f47-25b97830f8b6 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51122024-12-20T21:35:02.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6dc6f4bf-4cb5-4a5c-ae55-95b8fd5aa98c roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51132024-12-20T21:35:02.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6dc6f4bf-4cb5-4a5c-ae55-95b8fd5aa98c resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51142024-12-20T21:35:02.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2857 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6dc6f4bf-4cb5-4a5c-ae55-95b8fd5aa98c response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51152024-12-20T21:35:03.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cbd2a8ae-ab96-4d27-a423-1d5a01310a05 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51162024-12-20T21:35:03.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cbd2a8ae-ab96-4d27-a423-1d5a01310a05 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51172024-12-20T21:35:03.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cbd2a8ae-ab96-4d27-a423-1d5a01310a05 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51182024-12-20T21:35:04.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 45892722-1729-407c-b3ea-b1b8534f5336 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51192024-12-20T21:35:04.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 45892722-1729-407c-b3ea-b1b8534f5336 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51202024-12-20T21:35:04.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 45892722-1729-407c-b3ea-b1b8534f5336 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51212024-12-20T21:35:05.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d5330054-2ff1-43b7-aae6-045557c0cb9c roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51222024-12-20T21:35:05.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d5330054-2ff1-43b7-aae6-045557c0cb9c resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51232024-12-20T21:35:05.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2692 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d5330054-2ff1-43b7-aae6-045557c0cb9c response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51242024-12-20T21:35:06.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ebd52521-a1a4-48f7-a9db-bef80a14c772 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51252024-12-20T21:35:06.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ebd52521-a1a4-48f7-a9db-bef80a14c772 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51262024-12-20T21:35:06.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ebd52521-a1a4-48f7-a9db-bef80a14c772 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51272024-12-20T21:35:06.407ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 562 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 37ea90b5-59c8-42c4-8aea-36d9332df3e1 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
51282024-12-20T21:35:07.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a946b44e-473a-4b7a-a81f-01172f5c8c0c roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51292024-12-20T21:35:07.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a946b44e-473a-4b7a-a81f-01172f5c8c0c resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51302024-12-20T21:35:07.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a946b44e-473a-4b7a-a81f-01172f5c8c0c response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51312024-12-20T21:35:08.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0248bdef-72ea-4994-97ab-ea8d915f04ee roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51322024-12-20T21:35:08.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0248bdef-72ea-4994-97ab-ea8d915f04ee resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51332024-12-20T21:35:08.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0248bdef-72ea-4994-97ab-ea8d915f04ee response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51342024-12-20T21:35:09.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6702a5b4-eb57-4df9-9f79-0990d8ed868b roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51352024-12-20T21:35:09.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6702a5b4-eb57-4df9-9f79-0990d8ed868b resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51362024-12-20T21:35:09.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6702a5b4-eb57-4df9-9f79-0990d8ed868b response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51372024-12-20T21:35:09.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
51382024-12-20T21:35:09.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
51392024-12-20T21:35:09.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51402024-12-20T21:35:09.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51412024-12-20T21:35:09.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51422024-12-20T21:35:09.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51432024-12-20T21:35:09.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51442024-12-20T21:35:09.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51452024-12-20T21:35:09.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51462024-12-20T21:35:09.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51472024-12-20T21:35:09.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51482024-12-20T21:35:09.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51492024-12-20T21:35:09.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51502024-12-20T21:35:09.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51512024-12-20T21:35:09.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51522024-12-20T21:35:09.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
51532024-12-20T21:35:09.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51542024-12-20T21:35:09.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51552024-12-20T21:35:09.562ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
51562024-12-20T21:35:09.562ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.237219ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
51572024-12-20T21:35:09.572ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.312814ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51582024-12-20T21:35:10.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 15019480-c749-4b35-9c19-78d0990233e7 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51592024-12-20T21:35:10.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 15019480-c749-4b35-9c19-78d0990233e7 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51602024-12-20T21:35:10.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1922 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 15019480-c749-4b35-9c19-78d0990233e7 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51612024-12-20T21:35:11.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 573ccaac-72d1-44a7-b610-6e931fa688c9 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51622024-12-20T21:35:11.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 573ccaac-72d1-44a7-b610-6e931fa688c9 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51632024-12-20T21:35:11.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 573ccaac-72d1-44a7-b610-6e931fa688c9 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51642024-12-20T21:35:12.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0c02dc48-b63d-4fb3-993e-f71c5b053b37 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51652024-12-20T21:35:12.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0c02dc48-b63d-4fb3-993e-f71c5b053b37 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51662024-12-20T21:35:12.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0c02dc48-b63d-4fb3-993e-f71c5b053b37 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51672024-12-20T21:35:13.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = aded4d2a-23aa-43a9-b3cf-9687d9c78192 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51682024-12-20T21:35:13.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = aded4d2a-23aa-43a9-b3cf-9687d9c78192 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51692024-12-20T21:35:13.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = aded4d2a-23aa-43a9-b3cf-9687d9c78192 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51702024-12-20T21:35:14.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 16020e65-6579-4c55-af3c-081fe9724b07 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51712024-12-20T21:35:14.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 16020e65-6579-4c55-af3c-081fe9724b07 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51722024-12-20T21:35:14.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 16020e65-6579-4c55-af3c-081fe9724b07 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51732024-12-20T21:35:15.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3c8d8b58-49d0-4090-aebb-b50d9fd8e417 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51742024-12-20T21:35:15.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3c8d8b58-49d0-4090-aebb-b50d9fd8e417 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51752024-12-20T21:35:15.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2619 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3c8d8b58-49d0-4090-aebb-b50d9fd8e417 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51762024-12-20T21:35:16.407ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 574 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 671f0fa6-d1e2-4c9a-9bf6-6f1d41948b99 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
51772024-12-20T21:35:16.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cdc64386-2140-49c9-aa89-8addd0f7ed2e roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51782024-12-20T21:35:16.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cdc64386-2140-49c9-aa89-8addd0f7ed2e resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51792024-12-20T21:35:16.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cdc64386-2140-49c9-aa89-8addd0f7ed2e response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51802024-12-20T21:35:16.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 242840a5-4d5e-4d60-8598-8348002e3ab7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
51812024-12-20T21:35:16.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 242840a5-4d5e-4d60-8598-8348002e3ab7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
51822024-12-20T21:35:16.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 242840a5-4d5e-4d60-8598-8348002e3ab7 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
51832024-12-20T21:35:17.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 25bbf4b6-d441-41db-a070-69b00eda1dec roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51842024-12-20T21:35:17.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 25bbf4b6-d441-41db-a070-69b00eda1dec resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51852024-12-20T21:35:17.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 25bbf4b6-d441-41db-a070-69b00eda1dec response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51862024-12-20T21:35:18.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b4430f29-08bf-4e2f-bcc0-7afcbf4f23e3 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51872024-12-20T21:35:18.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b4430f29-08bf-4e2f-bcc0-7afcbf4f23e3 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51882024-12-20T21:35:18.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b4430f29-08bf-4e2f-bcc0-7afcbf4f23e3 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
51892024-12-20T21:35:19.539ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
51902024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
51912024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
51922024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51932024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
51942024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
51952024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
51962024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51972024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51982024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
51992024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
52002024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
52012024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
52022024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
52032024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
52042024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52052024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
52062024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52072024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
52082024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
52092024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
52102024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
52112024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
52122024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
52132024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
52142024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
52152024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
52162024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52172024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52182024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
52192024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
52202024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52212024-12-20T21:35:19.540ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 21:25:19.540215142 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
52222024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
52232024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
52242024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
52252024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52262024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
52272024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52282024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52292024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
52302024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
52312024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
52322024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52332024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
52342024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52352024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
52362024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52372024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
52382024-12-20T21:35:19.540ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9112287e-7109-46ca-aa8a-610048d83c82
52392024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.48\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"9112287e-7109-46ca-aa8a-610048d83c82"}
52402024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
52412024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
52422024-12-20T21:35:19.540ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
52432024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
52442024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52452024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52462024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
52472024-12-20T21:35:19.540ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
52482024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
52492024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
52502024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52512024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52522024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
52532024-12-20T21:35:19.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
52542024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52552024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52562024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52572024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52582024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
52592024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52602024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52612024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
52622024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52632024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52642024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
52652024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52662024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
52672024-12-20T21:35:19.541ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("065cea45-0eca-4287-90a0-2c3c20ec32f8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b24cb173-c3a3-4237-abe6-0e7953a415e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b24cb173-c3a3-4237-abe6-0e7953a415e5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1618, tv_nsec: 819409340 } })
52682024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
52692024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52702024-12-20T21:35:19.541ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4565f09e-ee63-469d-bb6e-3ccd4abd01fe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("73abfaca-4f35-4f97-9980-1890d6dba8fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3f6b067-d10e-44b3-9f21-f8e5a96a2b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3f6b067-d10e-44b3-9f21-f8e5a96a2b37.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1618, tv_nsec: 819427740 } })
52712024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
52722024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
52732024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52742024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52752024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52762024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52772024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
52782024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.34459ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
52792024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
52802024-12-20T21:35:19.541ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.437022ms iteration = 14 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
52812024-12-20T21:35:19.542ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1618, tv_nsec: 821354933 } })
52822024-12-20T21:35:19.543ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
52832024-12-20T21:35:19.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52842024-12-20T21:35:19.544ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.42691ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
52852024-12-20T21:35:19.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52862024-12-20T21:35:19.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
52872024-12-20T21:35:19.546ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52882024-12-20T21:35:19.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52892024-12-20T21:35:19.547ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52902024-12-20T21:35:19.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52912024-12-20T21:35:19.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52922024-12-20T21:35:19.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52932024-12-20T21:35:19.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52942024-12-20T21:35:19.549ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52952024-12-20T21:35:19.550ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 21:25:19.540215142 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
52962024-12-20T21:35:19.550ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.065926ms iteration = 14 status = {"expiration":"2024-12-20T21:25:19.540215142Z","pruned":[]}
52972024-12-20T21:35:19.550ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52982024-12-20T21:35:19.550ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
52992024-12-20T21:35:19.550ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53002024-12-20T21:35:19.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53012024-12-20T21:35:19.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
53022024-12-20T21:35:19.552ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53032024-12-20T21:35:19.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53042024-12-20T21:35:19.554ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53052024-12-20T21:35:19.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53062024-12-20T21:35:19.554ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.688769ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
53072024-12-20T21:35:19.556ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53082024-12-20T21:35:19.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53092024-12-20T21:35:19.557ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1618, tv_nsec: 835492780 } })
53102024-12-20T21:35:19.557ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
53112024-12-20T21:35:19.558ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53122024-12-20T21:35:19.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53132024-12-20T21:35:19.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53142024-12-20T21:35:19.558ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53152024-12-20T21:35:19.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53162024-12-20T21:35:19.560ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53172024-12-20T21:35:19.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53182024-12-20T21:35:19.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53192024-12-20T21:35:19.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53202024-12-20T21:35:19.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53212024-12-20T21:35:19.573ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53222024-12-20T21:35:19.575ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53232024-12-20T21:35:19.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53242024-12-20T21:35:19.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53252024-12-20T21:35:19.580ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
53262024-12-20T21:35:19.580ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
53272024-12-20T21:35:19.580ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
53282024-12-20T21:35:19.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53292024-12-20T21:35:19.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53302024-12-20T21:35:19.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53312024-12-20T21:35:19.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53322024-12-20T21:35:19.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53332024-12-20T21:35:19.585ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 45.356847ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
53342024-12-20T21:35:19.586ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53352024-12-20T21:35:19.586ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53362024-12-20T21:35:19.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53372024-12-20T21:35:19.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53382024-12-20T21:35:19.587ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53392024-12-20T21:35:19.588ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53402024-12-20T21:35:19.590ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53412024-12-20T21:35:19.590ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53422024-12-20T21:35:19.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53432024-12-20T21:35:19.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
53442024-12-20T21:35:19.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53452024-12-20T21:35:19.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53462024-12-20T21:35:19.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
53472024-12-20T21:35:19.592ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53482024-12-20T21:35:19.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53492024-12-20T21:35:19.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53502024-12-20T21:35:19.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53512024-12-20T21:35:19.593ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53522024-12-20T21:35:19.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53532024-12-20T21:35:19.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53542024-12-20T21:35:19.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53552024-12-20T21:35:19.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53562024-12-20T21:35:19.595ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53572024-12-20T21:35:19.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53582024-12-20T21:35:19.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53592024-12-20T21:35:19.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53602024-12-20T21:35:19.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53612024-12-20T21:35:19.602ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
53622024-12-20T21:35:19.602ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
53632024-12-20T21:35:19.602ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 61.962669ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
53642024-12-20T21:35:19.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53652024-12-20T21:35:19.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53662024-12-20T21:35:19.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53672024-12-20T21:35:19.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53682024-12-20T21:35:19.603ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.665808ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
53692024-12-20T21:35:19.604ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53702024-12-20T21:35:19.604ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
53712024-12-20T21:35:19.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53722024-12-20T21:35:19.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53732024-12-20T21:35:19.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d29c523d-136d-47c8-a88d-dea2d05af5f6 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
53742024-12-20T21:35:19.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d29c523d-136d-47c8-a88d-dea2d05af5f6 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
53752024-12-20T21:35:19.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d29c523d-136d-47c8-a88d-dea2d05af5f6 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
53762024-12-20T21:35:19.607ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53772024-12-20T21:35:19.607ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
53782024-12-20T21:35:19.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53792024-12-20T21:35:19.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53802024-12-20T21:35:19.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53812024-12-20T21:35:19.608ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53822024-12-20T21:35:19.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53832024-12-20T21:35:19.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53842024-12-20T21:35:19.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53852024-12-20T21:35:19.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53862024-12-20T21:35:19.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53872024-12-20T21:35:19.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53882024-12-20T21:35:19.611ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
53892024-12-20T21:35:19.611ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 71.888212ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
53902024-12-20T21:35:19.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53912024-12-20T21:35:19.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53922024-12-20T21:35:19.613ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1618, tv_nsec: 891953356 } })
53932024-12-20T21:35:19.613ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
53942024-12-20T21:35:19.614ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53952024-12-20T21:35:19.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c74ff24-982c-40fd-86fd-ef04898c5922, lookup_type: ById(8c74ff24-982c-40fd-86fd-ef04898c5922) } result = Ok(())
53962024-12-20T21:35:19.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53972024-12-20T21:35:19.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53982024-12-20T21:35:19.621ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 81.16141ms iteration = 27 status = 0
53992024-12-20T21:35:19.632ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
54002024-12-20T21:35:19.632ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
54012024-12-20T21:35:19.635ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
54022024-12-20T21:35:19.635ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 94.924859ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54032024-12-20T21:35:19.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
54042024-12-20T21:35:19.635ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
54052024-12-20T21:35:19.635ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c58feff7-51f2-445e-83fd-a0c3a102f4ed dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
54062024-12-20T21:35:19.635ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54072024-12-20T21:35:19.635ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
54082024-12-20T21:35:19.635ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
54092024-12-20T21:35:19.635ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 95.392179ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
54102024-12-20T21:35:19.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54112024-12-20T21:35:19.637ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
54122024-12-20T21:35:19.637ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
54132024-12-20T21:35:19.637ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
54142024-12-20T21:35:19.637ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54152024-12-20T21:35:19.637ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54162024-12-20T21:35:19.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54172024-12-20T21:35:19.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 98.170771ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54182024-12-20T21:35:19.639ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54192024-12-20T21:35:19.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54202024-12-20T21:35:19.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54212024-12-20T21:35:19.641ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54222024-12-20T21:35:19.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54232024-12-20T21:35:19.643ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54242024-12-20T21:35:19.645ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c58feff7-51f2-445e-83fd-a0c3a102f4ed dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
54252024-12-20T21:35:19.645ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
54262024-12-20T21:35:19.645ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 21:23:04.517297 UTC dns_group = internal generation = 1
54272024-12-20T21:35:19.645ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 105.088216ms iteration = 14 status = {"generation":1}
54282024-12-20T21:35:19.645ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54292024-12-20T21:35:19.645ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54302024-12-20T21:35:19.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54312024-12-20T21:35:19.646ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54322024-12-20T21:35:19.646ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
54332024-12-20T21:35:19.646ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 106.289714ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
54342024-12-20T21:35:19.648ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54352024-12-20T21:35:19.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54362024-12-20T21:35:19.655ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
54372024-12-20T21:35:19.655ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 114.984598ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
54382024-12-20T21:35:19.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 118.900706ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54392024-12-20T21:35:19.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54402024-12-20T21:35:19.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54412024-12-20T21:35:19.677ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54422024-12-20T21:35:19.677ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 137.068333ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
54432024-12-20T21:35:19.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54442024-12-20T21:35:19.682ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54452024-12-20T21:35:19.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54462024-12-20T21:35:19.685ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T21:22:10.640928Z, time_modified: 2024-12-20T21:22:10.640928Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, db_silo: Silo { identity: SiloIdentity { id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T21:23:05.471312Z, time_modified: 2024-12-20T21:23:05.471312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, db_silo: Silo { identity: SiloIdentity { id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T21:23:05.471312Z, time_modified: 2024-12-20T21:23:05.471312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b" }] }) }
54472024-12-20T21:35:19.685ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 145.318949ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"66e8bce1-b95a-4433-886f-e35fda6d9a14","tls_certs":["4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b"]}},"default_endpoint":{"silo_id":"66e8bce1-b95a-4433-886f-e35fda6d9a14","tls_certs":["4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
54482024-12-20T21:35:19.696ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
54492024-12-20T21:35:19.696ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54502024-12-20T21:35:19.696ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6245b49e-b167-4039-9033-96ee3c3287e1", "content-length": "26", "date": "Fri, 20 Dec 2024 21:35:19 GMT"} })
54512024-12-20T21:35:19.696ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54522024-12-20T21:35:19.697ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54532024-12-20T21:35:19.698ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
54542024-12-20T21:35:19.698ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 158.390281ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
54552024-12-20T21:35:19.705ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
54562024-12-20T21:35:19.705ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4aec9cd8-ad86-40dc-bdd7-2394e3237b38 dns_zone_name = oxide.test found_so_far = 0 version = 2
54572024-12-20T21:35:19.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54582024-12-20T21:35:19.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54592024-12-20T21:35:19.707ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54602024-12-20T21:35:19.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54612024-12-20T21:35:19.711ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54622024-12-20T21:35:19.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54632024-12-20T21:35:19.713ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4aec9cd8-ad86-40dc-bdd7-2394e3237b38 dns_zone_name = oxide.test found_so_far = 1 version = 2
54642024-12-20T21:35:19.713ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
54652024-12-20T21:35:19.713ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 21:23:05.526309 UTC dns_group = external generation = 2
54662024-12-20T21:35:19.713ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 172.925438ms iteration = 14 status = {"generation":2}
54672024-12-20T21:35:19.717ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
54682024-12-20T21:35:19.717ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54692024-12-20T21:35:19.717ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "44095878-01cd-4d23-9dea-1721c257bae3", "content-length": "26", "date": "Fri, 20 Dec 2024 21:35:19 GMT"} })
54702024-12-20T21:35:19.717ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54712024-12-20T21:35:19.718ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 178.140344ms iteration = 30 status = {"physical_disks_added":0}
54722024-12-20T21:35:19.718ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54732024-12-20T21:35:19.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54742024-12-20T21:35:19.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54752024-12-20T21:35:19.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54762024-12-20T21:35:19.725ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54772024-12-20T21:35:19.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54782024-12-20T21:35:19.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54792024-12-20T21:35:19.726ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54802024-12-20T21:35:19.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54812024-12-20T21:35:19.728ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54822024-12-20T21:35:19.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54832024-12-20T21:35:19.775ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
54842024-12-20T21:35:19.777ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
54852024-12-20T21:35:19.777ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "add42649-6941-4a12-807b-d775b7954ef0", "date": "Fri, 20 Dec 2024 21:35:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
54862024-12-20T21:35:19.777ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
54872024-12-20T21:35:19.778ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a24cd0ad-87fb-4435-80a1-fa134625cb78", "date": "Fri, 20 Dec 2024 21:35:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
54882024-12-20T21:35:19.778ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
54892024-12-20T21:35:19.780ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
54902024-12-20T21:35:19.780ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 240.83963ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
54912024-12-20T21:35:19.781ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac zone_address = fd00:1122:3344:101::2
54922024-12-20T21:35:19.781ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54932024-12-20T21:35:19.781ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bed61dad-d84f-4230-8c90-97de0cb82b6d", "content-length": "26", "date": "Fri, 20 Dec 2024 21:35:19 GMT"} })
54942024-12-20T21:35:19.781ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54952024-12-20T21:35:19.782ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
54962024-12-20T21:35:19.917ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 377.32339ms iteration = 27 status = {}
54972024-12-20T21:35:19.944ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
54982024-12-20T21:35:19.945ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e4ea057e-f33d-460e-9594-f90b57d6314e", "date": "Fri, 20 Dec 2024 21:35:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
54992024-12-20T21:35:19.945ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55002024-12-20T21:35:19.947ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "0c4f7d6d-f8ba-4ac7-82e3-ce28f27258cf", "date": "Fri, 20 Dec 2024 21:35:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55012024-12-20T21:35:19.947ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55022024-12-20T21:35:19.950ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b1ce8e52-0f16-497d-8c1a-00c9c0e502c7", "date": "Fri, 20 Dec 2024 21:35:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55032024-12-20T21:35:19.950ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55042024-12-20T21:35:19.953ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55052024-12-20T21:35:19.953ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 413.036001ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
55062024-12-20T21:35:19.963ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
55072024-12-20T21:35:19.963ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6545acd6-2f8f-4eab-94f2-cf12c6743fbe", "content-length": "691", "date": "Fri, 20 Dec 2024 21:35:19 GMT"} })
55082024-12-20T21:35:19.963ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
55092024-12-20T21:35:19.963ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
55102024-12-20T21:35:19.963ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
55112024-12-20T21:35:19.965ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 425.555202ms iteration = 28 status = {}
55122024-12-20T21:35:19.969ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55132024-12-20T21:35:19.969ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55142024-12-20T21:35:19.969ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "577281c3-5eb5-4c2a-aa1b-f7623824a841", "content-length": "372", "date": "Fri, 20 Dec 2024 21:35:19 GMT"} })
55152024-12-20T21:35:19.969ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55162024-12-20T21:35:19.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55172024-12-20T21:35:19.981ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55182024-12-20T21:35:19.981ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8a391e9-07fc-4ec2-b4be-b11ad9419cda", "content-length": "2", "date": "Fri, 20 Dec 2024 21:35:19 GMT"} })
55192024-12-20T21:35:19.983ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55202024-12-20T21:35:19.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55212024-12-20T21:35:19.987ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 447.045213ms iteration = 27 status = null
55222024-12-20T21:35:20.003ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
55232024-12-20T21:35:20.003ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
55242024-12-20T21:35:20.003ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7dcb857c-573c-43ff-b2f2-405dec8ac415", "date": "Fri, 20 Dec 2024 21:35:19 GMT"} })
55252024-12-20T21:35:20.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55262024-12-20T21:35:20.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55272024-12-20T21:35:20.007ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55282024-12-20T21:35:20.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55292024-12-20T21:35:20.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55302024-12-20T21:35:20.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55312024-12-20T21:35:20.019ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
55322024-12-20T21:35:20.019ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55332024-12-20T21:35:20.019ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ff166fb5-5de2-49a0-a9ac-c8bd8b436a14", "date": "Fri, 20 Dec 2024 21:35:19 GMT"} })
55342024-12-20T21:35:20.021ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 480.661128ms iteration = 28 status = {}
55352024-12-20T21:35:20.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55362024-12-20T21:35:20.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55372024-12-20T21:35:20.045ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 583388f4-92af-4a10-817c-62f2e9571310, rack_id: a7e68df9-95f5-4fda-aae0-2f46483e29ac, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bacaa666-9eda-4bc8-9ccd-35df228fd476) } rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
55382024-12-20T21:35:20.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55392024-12-20T21:35:20.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55402024-12-20T21:35:20.055ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
55412024-12-20T21:35:20.055ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d53367f-f6c4-41f1-ba3f-9c1d819f080c", "content-length": "134", "date": "Fri, 20 Dec 2024 21:35:19 GMT"} })
55422024-12-20T21:35:20.055ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
55432024-12-20T21:35:20.055ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bacaa666-9eda-4bc8-9ccd-35df228fd476
55442024-12-20T21:35:20.056ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
55452024-12-20T21:35:20.056ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55462024-12-20T21:35:20.056ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55472024-12-20T21:35:20.056ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55482024-12-20T21:35:20.056ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55492024-12-20T21:35:20.056ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55502024-12-20T21:35:20.056ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55512024-12-20T21:35:20.056ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55522024-12-20T21:35:20.056ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
55532024-12-20T21:35:20.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55542024-12-20T21:35:20.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55552024-12-20T21:35:20.058ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
55562024-12-20T21:35:20.059ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3afd6e22-c2f8-495b-9e8f-6501c689f2d9", "content-length": "2", "date": "Fri, 20 Dec 2024 21:35:19 GMT"} })
55572024-12-20T21:35:20.059ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
55582024-12-20T21:35:20.059ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e20adc48-cb42-43f1-98f6-3a741fb20eeb", "content-length": "52", "date": "Fri, 20 Dec 2024 21:35:19 GMT"} })
55592024-12-20T21:35:20.059ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
55602024-12-20T21:35:20.059ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
55612024-12-20T21:35:20.167ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2c0cba96-edf4-4a93-a2a4-835293ff6bad", "date": "Fri, 20 Dec 2024 21:35:19 GMT"} })
55622024-12-20T21:35:20.167ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch = Switch0
55632024-12-20T21:35:20.167ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
55642024-12-20T21:35:20.167ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "240b2127-4308-4bc8-a6a8-e73d8db70fb2", "content-length": "682", "date": "Fri, 20 Dec 2024 21:35:19 GMT"} })
55652024-12-20T21:35:20.167ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55662024-12-20T21:35:20.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55672024-12-20T21:35:20.171ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55682024-12-20T21:35:20.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55692024-12-20T21:35:20.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55702024-12-20T21:35:20.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55712024-12-20T21:35:20.178ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55722024-12-20T21:35:20.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55732024-12-20T21:35:20.185ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 645.219548ms iteration = 27 status = {}
55742024-12-20T21:35:20.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 04a28b6f-7e09-4e80-a3e4-d405477699a3 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55752024-12-20T21:35:20.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 04a28b6f-7e09-4e80-a3e4-d405477699a3 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55762024-12-20T21:35:20.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2745 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 04a28b6f-7e09-4e80-a3e4-d405477699a3 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55772024-12-20T21:35:21.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0de9953d-3abf-466e-83f5-2888333f3909 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55782024-12-20T21:35:21.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0de9953d-3abf-466e-83f5-2888333f3909 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55792024-12-20T21:35:21.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0de9953d-3abf-466e-83f5-2888333f3909 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55802024-12-20T21:35:22.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7c4b0ed9-1f87-4133-9f70-dc52df26b1b7 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55812024-12-20T21:35:22.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7c4b0ed9-1f87-4133-9f70-dc52df26b1b7 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55822024-12-20T21:35:22.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7c4b0ed9-1f87-4133-9f70-dc52df26b1b7 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55832024-12-20T21:35:23.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f4ba660b-e87e-496c-b258-094635194538 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55842024-12-20T21:35:23.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f4ba660b-e87e-496c-b258-094635194538 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55852024-12-20T21:35:23.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f4ba660b-e87e-496c-b258-094635194538 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55862024-12-20T21:35:24.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ff32b1bb-f594-41f8-b26b-3d76fb9360a1 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55872024-12-20T21:35:24.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ff32b1bb-f594-41f8-b26b-3d76fb9360a1 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55882024-12-20T21:35:24.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ff32b1bb-f594-41f8-b26b-3d76fb9360a1 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55892024-12-20T21:35:25.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 680c9f34-3752-40a7-bc75-451fcfb163e0 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55902024-12-20T21:35:25.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 680c9f34-3752-40a7-bc75-451fcfb163e0 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55912024-12-20T21:35:25.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 680c9f34-3752-40a7-bc75-451fcfb163e0 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55922024-12-20T21:35:26.406ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 584 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 263a0948-ad8a-4825-8107-a25c8f9117ed response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
55932024-12-20T21:35:26.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8d6128de-4666-4ecb-8b16-a0a5da0313dc roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55942024-12-20T21:35:26.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8d6128de-4666-4ecb-8b16-a0a5da0313dc resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55952024-12-20T21:35:26.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1711 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8d6128de-4666-4ecb-8b16-a0a5da0313dc response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55962024-12-20T21:35:27.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ecabe8d7-9a3f-4269-a5c1-99b68eef20e6 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55972024-12-20T21:35:27.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ecabe8d7-9a3f-4269-a5c1-99b68eef20e6 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55982024-12-20T21:35:27.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ecabe8d7-9a3f-4269-a5c1-99b68eef20e6 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
55992024-12-20T21:35:28.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = eb37efc7-8627-4d1a-92ff-d0d04dd851ad roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56002024-12-20T21:35:28.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = eb37efc7-8627-4d1a-92ff-d0d04dd851ad resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56012024-12-20T21:35:28.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = eb37efc7-8627-4d1a-92ff-d0d04dd851ad response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56022024-12-20T21:35:29.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
56032024-12-20T21:35:29.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56042024-12-20T21:35:29.539ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
56052024-12-20T21:35:29.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56062024-12-20T21:35:29.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56072024-12-20T21:35:29.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56082024-12-20T21:35:29.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56092024-12-20T21:35:29.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56102024-12-20T21:35:29.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56112024-12-20T21:35:29.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.943679ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56122024-12-20T21:35:29.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56132024-12-20T21:35:29.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56142024-12-20T21:35:29.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56152024-12-20T21:35:29.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56162024-12-20T21:35:29.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56172024-12-20T21:35:29.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56182024-12-20T21:35:29.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
56192024-12-20T21:35:29.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56202024-12-20T21:35:29.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56212024-12-20T21:35:29.564ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
56222024-12-20T21:35:29.564ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.422357ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
56232024-12-20T21:35:29.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 38aeb8e5-d652-4e6a-a040-f707c15ec8b6 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56242024-12-20T21:35:29.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 38aeb8e5-d652-4e6a-a040-f707c15ec8b6 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56252024-12-20T21:35:29.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1749 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 38aeb8e5-d652-4e6a-a040-f707c15ec8b6 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56262024-12-20T21:35:30.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ebfe6c41-9d66-44cb-9f05-3095d0dacb73 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56272024-12-20T21:35:30.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ebfe6c41-9d66-44cb-9f05-3095d0dacb73 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56282024-12-20T21:35:30.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ebfe6c41-9d66-44cb-9f05-3095d0dacb73 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56292024-12-20T21:35:31.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 50539d08-6c86-4d96-8534-f22498e47e27 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56302024-12-20T21:35:31.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 50539d08-6c86-4d96-8534-f22498e47e27 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56312024-12-20T21:35:31.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 50539d08-6c86-4d96-8534-f22498e47e27 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56322024-12-20T21:35:32.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5381696d-aa33-43b9-8135-6a7e73d57621 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56332024-12-20T21:35:32.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5381696d-aa33-43b9-8135-6a7e73d57621 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56342024-12-20T21:35:32.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2648 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5381696d-aa33-43b9-8135-6a7e73d57621 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56352024-12-20T21:35:34.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2a022967-7e23-448a-8981-713d4291b94e roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56362024-12-20T21:35:34.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2a022967-7e23-448a-8981-713d4291b94e resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56372024-12-20T21:35:34.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2a022967-7e23-448a-8981-713d4291b94e response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56382024-12-20T21:35:35.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 76b73816-227a-40cb-aa96-e82d5deca9df roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56392024-12-20T21:35:35.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 76b73816-227a-40cb-aa96-e82d5deca9df resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56402024-12-20T21:35:35.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2526 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 76b73816-227a-40cb-aa96-e82d5deca9df response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56412024-12-20T21:35:36.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8d6c65b0-6d90-499e-8593-4e13fcfd8602 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56422024-12-20T21:35:36.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8d6c65b0-6d90-499e-8593-4e13fcfd8602 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56432024-12-20T21:35:36.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8d6c65b0-6d90-499e-8593-4e13fcfd8602 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56442024-12-20T21:35:36.407ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 676 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 387f78ce-8727-4be4-9189-95595dd92f0b response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
56452024-12-20T21:35:37.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8cd5c112-cef0-43c3-8088-d8d655ee14b9 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56462024-12-20T21:35:37.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8cd5c112-cef0-43c3-8088-d8d655ee14b9 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56472024-12-20T21:35:37.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8cd5c112-cef0-43c3-8088-d8d655ee14b9 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56482024-12-20T21:35:38.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3a3747f9-7ba8-456d-bcd1-ec0e91edd14a roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56492024-12-20T21:35:38.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3a3747f9-7ba8-456d-bcd1-ec0e91edd14a resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56502024-12-20T21:35:38.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3a3747f9-7ba8-456d-bcd1-ec0e91edd14a response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56512024-12-20T21:35:39.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = eb7e48d5-3220-428f-82bc-d6830d575f42 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56522024-12-20T21:35:39.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = eb7e48d5-3220-428f-82bc-d6830d575f42 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56532024-12-20T21:35:39.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2707 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = eb7e48d5-3220-428f-82bc-d6830d575f42 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56542024-12-20T21:35:39.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
56552024-12-20T21:35:39.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
56562024-12-20T21:35:39.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56572024-12-20T21:35:39.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56582024-12-20T21:35:39.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56592024-12-20T21:35:39.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56602024-12-20T21:35:39.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56612024-12-20T21:35:39.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56622024-12-20T21:35:39.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56632024-12-20T21:35:39.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.796838ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56642024-12-20T21:35:39.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56652024-12-20T21:35:39.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56662024-12-20T21:35:39.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56672024-12-20T21:35:39.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56682024-12-20T21:35:39.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56692024-12-20T21:35:39.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56702024-12-20T21:35:39.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
56712024-12-20T21:35:39.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56722024-12-20T21:35:39.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56732024-12-20T21:35:39.564ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
56742024-12-20T21:35:39.564ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.780233ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
56752024-12-20T21:35:40.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ffcafd8d-3719-41c0-aeba-f3949d694d10 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56762024-12-20T21:35:40.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ffcafd8d-3719-41c0-aeba-f3949d694d10 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56772024-12-20T21:35:40.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ffcafd8d-3719-41c0-aeba-f3949d694d10 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56782024-12-20T21:35:41.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 858f303d-3646-44c7-adfb-ad8f583d2877 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56792024-12-20T21:35:41.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 858f303d-3646-44c7-adfb-ad8f583d2877 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56802024-12-20T21:35:41.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2777 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 858f303d-3646-44c7-adfb-ad8f583d2877 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56812024-12-20T21:35:42.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 41a06733-91f5-4e5b-a901-e4d24f6d6a48 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56822024-12-20T21:35:42.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 41a06733-91f5-4e5b-a901-e4d24f6d6a48 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56832024-12-20T21:35:42.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 41a06733-91f5-4e5b-a901-e4d24f6d6a48 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56842024-12-20T21:35:43.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9e3fc94f-400a-4178-9318-c7f937622988 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56852024-12-20T21:35:43.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9e3fc94f-400a-4178-9318-c7f937622988 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56862024-12-20T21:35:43.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9e3fc94f-400a-4178-9318-c7f937622988 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56872024-12-20T21:35:44.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 260f8231-e54d-45c7-b065-07227a5b85bb roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56882024-12-20T21:35:44.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 260f8231-e54d-45c7-b065-07227a5b85bb resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56892024-12-20T21:35:44.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 260f8231-e54d-45c7-b065-07227a5b85bb response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56902024-12-20T21:35:45.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f6e38652-c3d5-4ae7-82bb-395234b320cf roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56912024-12-20T21:35:45.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f6e38652-c3d5-4ae7-82bb-395234b320cf resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56922024-12-20T21:35:45.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f6e38652-c3d5-4ae7-82bb-395234b320cf response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56932024-12-20T21:35:46.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 386be7d1-5b09-4d9a-9cd2-1270e4724535 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56942024-12-20T21:35:46.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 386be7d1-5b09-4d9a-9cd2-1270e4724535 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56952024-12-20T21:35:46.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2640 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 386be7d1-5b09-4d9a-9cd2-1270e4724535 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
56962024-12-20T21:35:46.407ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 644 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 1a371223-7ceb-4299-bce8-20222669bc64 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
56972024-12-20T21:35:46.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = d2f63504-17c8-426b-8c26-7bfdfcace4f9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
56982024-12-20T21:35:46.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = d2f63504-17c8-426b-8c26-7bfdfcace4f9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
56992024-12-20T21:35:46.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3547 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = d2f63504-17c8-426b-8c26-7bfdfcace4f9 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
57002024-12-20T21:35:47.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a315bdff-33ea-4037-beac-7233f0765af0 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
57012024-12-20T21:35:47.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a315bdff-33ea-4037-beac-7233f0765af0 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
57022024-12-20T21:35:47.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a315bdff-33ea-4037-beac-7233f0765af0 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
57032024-12-20T21:35:48.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 11418d3a-cdad-43ed-bb51-524689e7a911 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
57042024-12-20T21:35:48.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 11418d3a-cdad-43ed-bb51-524689e7a911 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
57052024-12-20T21:35:48.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 11418d3a-cdad-43ed-bb51-524689e7a911 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
57062024-12-20T21:35:49.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 89bc9f27-75ef-4b5e-ac61-c5caa545b6af roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
57072024-12-20T21:35:49.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 89bc9f27-75ef-4b5e-ac61-c5caa545b6af resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
57082024-12-20T21:35:49.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 89bc9f27-75ef-4b5e-ac61-c5caa545b6af response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
57092024-12-20T21:35:49.539ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
57102024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57112024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
57122024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57132024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
57142024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57152024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57162024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
57172024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57182024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
57192024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57202024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
57212024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
57222024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57232024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
57242024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
57252024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
57262024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57272024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
57282024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
57292024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57302024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
57312024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57322024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
57332024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
57342024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
57352024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
57362024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
57372024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57382024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
57392024-12-20T21:35:49.540ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
57402024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57412024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57422024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
57432024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57442024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57452024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57462024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57472024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57482024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57492024-12-20T21:35:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57502024-12-20T21:35:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57512024-12-20T21:35:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57522024-12-20T21:35:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
57532024-12-20T21:35:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57542024-12-20T21:35:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57552024-12-20T21:35:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
57562024-12-20T21:35:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
57572024-12-20T21:35:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57582024-12-20T21:35:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57592024-12-20T21:35:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57602024-12-20T21:35:49.544ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1648, tv_nsec: 822347603 } })
57612024-12-20T21:35:49.544ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57622024-12-20T21:35:49.544ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
57632024-12-20T21:35:49.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57642024-12-20T21:35:49.544ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
57652024-12-20T21:35:49.544ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.182594ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
57662024-12-20T21:35:49.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57672024-12-20T21:35:49.544ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57682024-12-20T21:35:49.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57692024-12-20T21:35:49.546ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57702024-12-20T21:35:49.546ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57712024-12-20T21:35:49.546ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57722024-12-20T21:35:49.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57732024-12-20T21:35:49.548ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57742024-12-20T21:35:49.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
57752024-12-20T21:35:49.548ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57762024-12-20T21:35:49.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57772024-12-20T21:35:49.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57782024-12-20T21:35:49.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57792024-12-20T21:35:49.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57802024-12-20T21:35:49.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57812024-12-20T21:35:49.550ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.929393ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
57822024-12-20T21:35:49.551ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1648, tv_nsec: 829320319 } })
57832024-12-20T21:35:49.551ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
57842024-12-20T21:35:49.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57852024-12-20T21:35:49.551ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57862024-12-20T21:35:49.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57872024-12-20T21:35:49.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57882024-12-20T21:35:49.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57892024-12-20T21:35:49.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57902024-12-20T21:35:49.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57912024-12-20T21:35:49.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57922024-12-20T21:35:49.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
57932024-12-20T21:35:49.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57942024-12-20T21:35:49.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57952024-12-20T21:35:49.556ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57962024-12-20T21:35:49.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57972024-12-20T21:35:49.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57982024-12-20T21:35:49.560ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57992024-12-20T21:35:49.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58002024-12-20T21:35:49.561ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58012024-12-20T21:35:49.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58022024-12-20T21:35:49.562ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1648, tv_nsec: 840938079 } })
58032024-12-20T21:35:49.563ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
58042024-12-20T21:35:49.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58052024-12-20T21:35:49.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58062024-12-20T21:35:49.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58072024-12-20T21:35:49.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58082024-12-20T21:35:49.587ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 46.788069ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
58092024-12-20T21:35:49.592ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58102024-12-20T21:35:49.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58112024-12-20T21:35:49.592ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58122024-12-20T21:35:49.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58132024-12-20T21:35:49.594ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 54.189665ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
58142024-12-20T21:35:49.595ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 55.011213ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
58152024-12-20T21:35:49.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58162024-12-20T21:35:49.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58172024-12-20T21:35:49.597ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58182024-12-20T21:35:49.597ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
58192024-12-20T21:35:49.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58202024-12-20T21:35:49.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58212024-12-20T21:35:49.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58222024-12-20T21:35:49.598ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58232024-12-20T21:35:49.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58242024-12-20T21:35:49.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58252024-12-20T21:35:49.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58262024-12-20T21:35:49.602ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
58272024-12-20T21:35:49.602ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58282024-12-20T21:35:49.603ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "79526fab-88b1-49f9-b98d-fffc2c861cbb", "content-length": "26", "date": "Fri, 20 Dec 2024 21:35:49 GMT"} })
58292024-12-20T21:35:49.603ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58302024-12-20T21:35:49.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
58312024-12-20T21:35:49.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58322024-12-20T21:35:49.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58332024-12-20T21:35:49.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58342024-12-20T21:35:49.604ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58352024-12-20T21:35:49.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58362024-12-20T21:35:49.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58372024-12-20T21:35:49.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58382024-12-20T21:35:49.606ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58392024-12-20T21:35:49.606ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.555233ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58402024-12-20T21:35:49.613ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
58412024-12-20T21:35:49.613ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 72.892454ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
58422024-12-20T21:35:49.619ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
58432024-12-20T21:35:49.619ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58442024-12-20T21:35:49.619ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "705f2231-00e6-4c0c-b6ad-ffd16f4c3107", "content-length": "26", "date": "Fri, 20 Dec 2024 21:35:49 GMT"} })
58452024-12-20T21:35:49.619ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58462024-12-20T21:35:49.620ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58472024-12-20T21:35:49.621ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.287313ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58482024-12-20T21:35:49.629ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58492024-12-20T21:35:49.629ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58502024-12-20T21:35:49.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58512024-12-20T21:35:49.629ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58522024-12-20T21:35:49.629ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
58532024-12-20T21:35:49.629ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 89.666601ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
58542024-12-20T21:35:49.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c74ff24-982c-40fd-86fd-ef04898c5922, lookup_type: ById(8c74ff24-982c-40fd-86fd-ef04898c5922) } result = Ok(())
58552024-12-20T21:35:49.631ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58562024-12-20T21:35:49.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58572024-12-20T21:35:49.634ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 94.09292ms iteration = 28 status = 0
58582024-12-20T21:35:49.640ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 100.3542ms iteration = 31 status = {"physical_disks_added":0}
58592024-12-20T21:35:49.656ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac zone_address = fd00:1122:3344:101::2
58602024-12-20T21:35:49.656ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58612024-12-20T21:35:49.656ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8135048-0b41-47e0-aa00-ed54876b9073", "content-length": "26", "date": "Fri, 20 Dec 2024 21:35:49 GMT"} })
58622024-12-20T21:35:49.656ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58632024-12-20T21:35:49.656ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58642024-12-20T21:35:49.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58652024-12-20T21:35:49.658ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 117.860102ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
58662024-12-20T21:35:49.658ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
58672024-12-20T21:35:49.679ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
58682024-12-20T21:35:49.679ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "662c3060-06c6-4657-a160-e7daef7c07cf", "content-length": "2", "date": "Fri, 20 Dec 2024 21:35:48 GMT"} })
58692024-12-20T21:35:49.680ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58702024-12-20T21:35:49.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58712024-12-20T21:35:49.682ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 142.501675ms iteration = 28 status = null
58722024-12-20T21:35:49.688ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 148.557641ms iteration = 28 status = {}
58732024-12-20T21:35:49.693ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
58742024-12-20T21:35:49.693ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58752024-12-20T21:35:49.694ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ce01fed-3cda-4120-b97b-f8587e5153c7", "content-length": "372", "date": "Fri, 20 Dec 2024 21:35:49 GMT"} })
58762024-12-20T21:35:49.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58772024-12-20T21:35:49.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58782024-12-20T21:35:49.737ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
58792024-12-20T21:35:49.737ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
58802024-12-20T21:35:49.737ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "faf7ec61-4bbe-4fa8-8d3d-38e405905b48", "date": "Fri, 20 Dec 2024 21:35:49 GMT"} })
58812024-12-20T21:35:49.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58822024-12-20T21:35:49.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58832024-12-20T21:35:49.741ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58842024-12-20T21:35:49.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58852024-12-20T21:35:49.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58862024-12-20T21:35:49.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58872024-12-20T21:35:49.746ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
58882024-12-20T21:35:49.746ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58892024-12-20T21:35:49.747ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dfd1ab24-27ea-44e7-b0a5-3d34c11698ba", "date": "Fri, 20 Dec 2024 21:35:49 GMT"} })
58902024-12-20T21:35:49.748ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58912024-12-20T21:35:49.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58922024-12-20T21:35:49.748ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 208.185278ms iteration = 29 status = {}
58932024-12-20T21:35:49.750ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58942024-12-20T21:35:49.752ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58952024-12-20T21:35:49.752ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58962024-12-20T21:35:49.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58972024-12-20T21:35:49.753ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58982024-12-20T21:35:49.755ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58992024-12-20T21:35:49.755ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59002024-12-20T21:35:49.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59012024-12-20T21:35:49.794ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59022024-12-20T21:35:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59032024-12-20T21:35:49.797ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 583388f4-92af-4a10-817c-62f2e9571310, rack_id: a7e68df9-95f5-4fda-aae0-2f46483e29ac, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bacaa666-9eda-4bc8-9ccd-35df228fd476) } rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
59042024-12-20T21:35:49.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59052024-12-20T21:35:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59062024-12-20T21:35:49.806ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
59072024-12-20T21:35:49.806ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7dd5727-2be6-43ae-86a8-27852b57c580", "content-length": "134", "date": "Fri, 20 Dec 2024 21:35:49 GMT"} })
59082024-12-20T21:35:49.806ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
59092024-12-20T21:35:49.806ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bacaa666-9eda-4bc8-9ccd-35df228fd476
59102024-12-20T21:35:49.806ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
59112024-12-20T21:35:49.806ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
59122024-12-20T21:35:49.806ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59132024-12-20T21:35:49.806ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59142024-12-20T21:35:49.806ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59152024-12-20T21:35:49.806ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59162024-12-20T21:35:49.807ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59172024-12-20T21:35:49.807ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59182024-12-20T21:35:49.807ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
59192024-12-20T21:35:49.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59202024-12-20T21:35:49.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59212024-12-20T21:35:49.808ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
59222024-12-20T21:35:49.808ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a284f98-0fed-4112-96e7-c7adff6d97ae", "content-length": "2", "date": "Fri, 20 Dec 2024 21:35:49 GMT"} })
59232024-12-20T21:35:49.808ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
59242024-12-20T21:35:49.808ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "780664f4-7717-4826-b2c3-4029820718cb", "content-length": "52", "date": "Fri, 20 Dec 2024 21:35:49 GMT"} })
59252024-12-20T21:35:49.809ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
59262024-12-20T21:35:49.809ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
59272024-12-20T21:35:49.816ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59282024-12-20T21:35:49.906ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8817c9d0-4d71-43c0-b52d-122cc31659bb", "date": "Fri, 20 Dec 2024 21:35:49 GMT"} })
59292024-12-20T21:35:49.906ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch = Switch0
59302024-12-20T21:35:49.906ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
59312024-12-20T21:35:49.906ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "827e8c96-14d1-4322-a563-5175f7cb0c73", "content-length": "691", "date": "Fri, 20 Dec 2024 21:35:49 GMT"} })
59322024-12-20T21:35:49.906ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
59332024-12-20T21:35:49.906ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
59342024-12-20T21:35:49.906ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
59352024-12-20T21:35:49.906ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d6e2849-a666-4241-94c1-84db22bf78f9", "content-length": "682", "date": "Fri, 20 Dec 2024 21:35:49 GMT"} })
59362024-12-20T21:35:49.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59372024-12-20T21:35:49.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59382024-12-20T21:35:49.908ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 368.164195ms iteration = 29 status = {}
59392024-12-20T21:35:49.911ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59402024-12-20T21:35:49.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59412024-12-20T21:35:49.917ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59422024-12-20T21:35:49.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59432024-12-20T21:35:49.920ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59442024-12-20T21:35:49.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59452024-12-20T21:35:49.929ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 388.818098ms iteration = 28 status = {}
59462024-12-20T21:35:50.320ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
59472024-12-20T21:35:50.320ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
59482024-12-20T21:35:50.357ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
59492024-12-20T21:35:50.357ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:65534
59502024-12-20T21:35:50.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:65534 req_id = 0b5b5b27-7bb8-4052-95b0-66a03fb70c5a roles = RoleSet { roles: {} } uri = /metrics/producers
59512024-12-20T21:35:50.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:65534 req_id = 0b5b5b27-7bb8-4052-95b0-66a03fb70c5a resource = Database result = Ok(()) uri = /metrics/producers
59522024-12-20T21:35:50.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 62622da4-197f-419f-be86-d570ea0c9eb6 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59532024-12-20T21:35:50.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 62622da4-197f-419f-be86-d570ea0c9eb6 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59542024-12-20T21:35:50.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2732 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 62622da4-197f-419f-be86-d570ea0c9eb6 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59552024-12-20T21:35:50.397ZINFOnexus: assigned collector to new producer collector_id = f413b9dc-12d9-42dc-9e49-cb25b63f7e80 file = nexus/src/app/oximeter.rs:76 producer_id = 12bea37a-3ccb-4c9f-8c92-9d6095867a0f
59562024-12-20T21:35:50.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39929 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:65534 req_id = 0b5b5b27-7bb8-4052-95b0-66a03fb70c5a response_code = 201 uri = /metrics/producers
59572024-12-20T21:35:50.397ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "0b5b5b27-7bb8-4052-95b0-66a03fb70c5a", "content-length": "41", "date": "Fri, 20 Dec 2024 21:35:50 GMT"} })
59582024-12-20T21:35:50.399ZDEBGnexus (producer-registration-task): registered with nexus successfully
59592024-12-20T21:35:50.399ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
59602024-12-20T21:35:51.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f362324f-f98f-4c91-9888-5592a5529cad roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59612024-12-20T21:35:51.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f362324f-f98f-4c91-9888-5592a5529cad resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59622024-12-20T21:35:51.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f362324f-f98f-4c91-9888-5592a5529cad response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59632024-12-20T21:35:52.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8e8bca01-ee65-4d82-8e2c-9fb6392ac16a roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59642024-12-20T21:35:52.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8e8bca01-ee65-4d82-8e2c-9fb6392ac16a resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59652024-12-20T21:35:52.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2841 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8e8bca01-ee65-4d82-8e2c-9fb6392ac16a response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59662024-12-20T21:35:53.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6e00dbdd-f5e0-46b0-9078-d07a588f30db roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59672024-12-20T21:35:53.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6e00dbdd-f5e0-46b0-9078-d07a588f30db resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59682024-12-20T21:35:53.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6e00dbdd-f5e0-46b0-9078-d07a588f30db response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59692024-12-20T21:35:54.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 110c6e51-dcb6-446d-9822-62f8e2db0446 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59702024-12-20T21:35:54.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 110c6e51-dcb6-446d-9822-62f8e2db0446 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59712024-12-20T21:35:54.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2777 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 110c6e51-dcb6-446d-9822-62f8e2db0446 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59722024-12-20T21:35:55.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6607d280-7cb3-4b7d-b88e-58862f04cef0 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59732024-12-20T21:35:55.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6607d280-7cb3-4b7d-b88e-58862f04cef0 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59742024-12-20T21:35:55.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6607d280-7cb3-4b7d-b88e-58862f04cef0 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59752024-12-20T21:35:56.406ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 568 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 3fce9112-76c5-4ec9-a89a-372bb4978c61 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
59762024-12-20T21:35:56.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d0989847-b107-483c-a185-283cda707f73 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59772024-12-20T21:35:56.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d0989847-b107-483c-a185-283cda707f73 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59782024-12-20T21:35:56.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1867 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d0989847-b107-483c-a185-283cda707f73 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59792024-12-20T21:35:57.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ea5a08e1-908e-40f2-a297-01f696767332 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59802024-12-20T21:35:57.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ea5a08e1-908e-40f2-a297-01f696767332 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59812024-12-20T21:35:57.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ea5a08e1-908e-40f2-a297-01f696767332 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59822024-12-20T21:35:58.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8202413b-53f7-4309-997e-70e4f907f8d1 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59832024-12-20T21:35:58.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8202413b-53f7-4309-997e-70e4f907f8d1 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59842024-12-20T21:35:58.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8202413b-53f7-4309-997e-70e4f907f8d1 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
59852024-12-20T21:35:59.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
59862024-12-20T21:35:59.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
59872024-12-20T21:35:59.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59882024-12-20T21:35:59.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59892024-12-20T21:35:59.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59902024-12-20T21:35:59.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59912024-12-20T21:35:59.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59922024-12-20T21:35:59.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59932024-12-20T21:35:59.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59942024-12-20T21:35:59.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59952024-12-20T21:35:59.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59962024-12-20T21:35:59.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59972024-12-20T21:35:59.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59982024-12-20T21:35:59.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
59992024-12-20T21:35:59.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60002024-12-20T21:35:59.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60012024-12-20T21:35:59.560ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
60022024-12-20T21:35:59.560ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.411808ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
60032024-12-20T21:35:59.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 86e1a1ef-892b-4439-b994-7102c9a498b5 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60042024-12-20T21:35:59.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 86e1a1ef-892b-4439-b994-7102c9a498b5 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60052024-12-20T21:35:59.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 86e1a1ef-892b-4439-b994-7102c9a498b5 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60062024-12-20T21:35:59.570ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60072024-12-20T21:35:59.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60082024-12-20T21:35:59.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.948886ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60092024-12-20T21:36:00.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5b357d4a-77d8-43dc-baed-a340f56b13e5 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60102024-12-20T21:36:00.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5b357d4a-77d8-43dc-baed-a340f56b13e5 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60112024-12-20T21:36:00.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5b357d4a-77d8-43dc-baed-a340f56b13e5 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60122024-12-20T21:36:01.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 67bdbddb-52b4-46f7-9b61-d99bb4217c4a roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60132024-12-20T21:36:01.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 67bdbddb-52b4-46f7-9b61-d99bb4217c4a resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60142024-12-20T21:36:01.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 67bdbddb-52b4-46f7-9b61-d99bb4217c4a response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60152024-12-20T21:36:02.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c18bd555-4c8a-4023-933b-a52e9219c68f roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60162024-12-20T21:36:02.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c18bd555-4c8a-4023-933b-a52e9219c68f resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60172024-12-20T21:36:02.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c18bd555-4c8a-4023-933b-a52e9219c68f response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60182024-12-20T21:36:03.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 385f62d8-145b-4dbd-9d6a-e4f7d796235a roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60192024-12-20T21:36:03.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 385f62d8-145b-4dbd-9d6a-e4f7d796235a resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60202024-12-20T21:36:03.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 385f62d8-145b-4dbd-9d6a-e4f7d796235a response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60212024-12-20T21:36:04.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0fd79496-5ea2-4592-a6f6-779d16cbc9d0 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60222024-12-20T21:36:04.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0fd79496-5ea2-4592-a6f6-779d16cbc9d0 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60232024-12-20T21:36:04.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2660 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0fd79496-5ea2-4592-a6f6-779d16cbc9d0 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60242024-12-20T21:36:05.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 52f2c0e2-4a34-4dfb-98f6-b31e0b68ad9d roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60252024-12-20T21:36:05.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 52f2c0e2-4a34-4dfb-98f6-b31e0b68ad9d resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60262024-12-20T21:36:05.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 52f2c0e2-4a34-4dfb-98f6-b31e0b68ad9d response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60272024-12-20T21:36:06.407ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 559 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = f7ceecc1-493f-42a2-b5e6-8483ba8ad0b5 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
60282024-12-20T21:36:06.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3001a4fb-d55d-4fce-8b60-8867bd1dc1f9 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60292024-12-20T21:36:06.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3001a4fb-d55d-4fce-8b60-8867bd1dc1f9 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60302024-12-20T21:36:06.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3001a4fb-d55d-4fce-8b60-8867bd1dc1f9 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60312024-12-20T21:36:07.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9ac3900d-ee4b-4080-9dfc-67e5d41a16c1 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60322024-12-20T21:36:07.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9ac3900d-ee4b-4080-9dfc-67e5d41a16c1 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60332024-12-20T21:36:07.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9ac3900d-ee4b-4080-9dfc-67e5d41a16c1 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60342024-12-20T21:36:08.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8eda5043-96ae-4455-9945-e187cbcdc2cb roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60352024-12-20T21:36:08.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8eda5043-96ae-4455-9945-e187cbcdc2cb resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60362024-12-20T21:36:08.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2592 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8eda5043-96ae-4455-9945-e187cbcdc2cb response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60372024-12-20T21:36:09.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
60382024-12-20T21:36:09.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
60392024-12-20T21:36:09.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60402024-12-20T21:36:09.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60412024-12-20T21:36:09.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60422024-12-20T21:36:09.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60432024-12-20T21:36:09.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60442024-12-20T21:36:09.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60452024-12-20T21:36:09.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60462024-12-20T21:36:09.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.818126ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60472024-12-20T21:36:09.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60482024-12-20T21:36:09.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60492024-12-20T21:36:09.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60502024-12-20T21:36:09.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60512024-12-20T21:36:09.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60522024-12-20T21:36:09.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60532024-12-20T21:36:09.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
60542024-12-20T21:36:09.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60552024-12-20T21:36:09.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60562024-12-20T21:36:09.563ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
60572024-12-20T21:36:09.563ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.841292ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
60582024-12-20T21:36:09.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2ec2495d-f2e8-42c0-901a-e7c3d2bcc05b roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60592024-12-20T21:36:09.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2ec2495d-f2e8-42c0-901a-e7c3d2bcc05b resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60602024-12-20T21:36:09.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1772 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2ec2495d-f2e8-42c0-901a-e7c3d2bcc05b response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60612024-12-20T21:36:10.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d5cfdf9f-87bc-44c2-9c8f-dcb90d599f98 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60622024-12-20T21:36:10.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d5cfdf9f-87bc-44c2-9c8f-dcb90d599f98 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60632024-12-20T21:36:10.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d5cfdf9f-87bc-44c2-9c8f-dcb90d599f98 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60642024-12-20T21:36:11.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b7b48b15-9abc-41df-8149-4255805383be roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60652024-12-20T21:36:11.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b7b48b15-9abc-41df-8149-4255805383be resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60662024-12-20T21:36:11.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b7b48b15-9abc-41df-8149-4255805383be response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60672024-12-20T21:36:12.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e00db65b-0baa-4ad0-9873-20af046b107d roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60682024-12-20T21:36:12.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e00db65b-0baa-4ad0-9873-20af046b107d resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60692024-12-20T21:36:12.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e00db65b-0baa-4ad0-9873-20af046b107d response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60702024-12-20T21:36:13.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 967822ab-d304-46bf-88bb-29ce5b976233 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60712024-12-20T21:36:13.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 967822ab-d304-46bf-88bb-29ce5b976233 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60722024-12-20T21:36:13.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2004 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 967822ab-d304-46bf-88bb-29ce5b976233 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60732024-12-20T21:36:14.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3329fd28-78cc-4762-acb8-abd82b90e088 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60742024-12-20T21:36:14.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3329fd28-78cc-4762-acb8-abd82b90e088 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60752024-12-20T21:36:14.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3329fd28-78cc-4762-acb8-abd82b90e088 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60762024-12-20T21:36:15.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4e2b435a-5467-427f-a421-03cd2038d1c7 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60772024-12-20T21:36:15.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4e2b435a-5467-427f-a421-03cd2038d1c7 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60782024-12-20T21:36:15.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4e2b435a-5467-427f-a421-03cd2038d1c7 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60792024-12-20T21:36:16.407ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 576 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 08187de4-d604-495b-bd96-981ed5b23a62 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
60802024-12-20T21:36:16.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 49df19d9-55f2-40dc-b5ff-51ebd2c71db5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
60812024-12-20T21:36:16.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 49df19d9-55f2-40dc-b5ff-51ebd2c71db5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
60822024-12-20T21:36:16.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 49df19d9-55f2-40dc-b5ff-51ebd2c71db5 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
60832024-12-20T21:36:16.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b5d24f95-b908-4d41-b677-20055081d196 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60842024-12-20T21:36:16.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b5d24f95-b908-4d41-b677-20055081d196 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60852024-12-20T21:36:16.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b5d24f95-b908-4d41-b677-20055081d196 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60862024-12-20T21:36:17.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 09e60842-040d-47c2-ac26-7a60db00fd14 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60872024-12-20T21:36:17.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 09e60842-040d-47c2-ac26-7a60db00fd14 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60882024-12-20T21:36:17.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 09e60842-040d-47c2-ac26-7a60db00fd14 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60892024-12-20T21:36:18.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d0d69a05-7c4f-4581-b59e-6d4c83a4adf4 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60902024-12-20T21:36:18.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d0d69a05-7c4f-4581-b59e-6d4c83a4adf4 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60912024-12-20T21:36:18.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1965 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d0d69a05-7c4f-4581-b59e-6d4c83a4adf4 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
60922024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
60932024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
60942024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
60952024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
60962024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60972024-12-20T21:36:19.540ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
60982024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60992024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61002024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
61012024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
61022024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61032024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
61042024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
61052024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61062024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
61072024-12-20T21:36:19.540ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
61082024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
61092024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61102024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61112024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
61122024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
61132024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
61142024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61152024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61162024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
61172024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
61182024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61192024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
61202024-12-20T21:36:19.540ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9112287e-7109-46ca-aa8a-610048d83c82
61212024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61222024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.1\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"9112287e-7109-46ca-aa8a-610048d83c82"}
61232024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
61242024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61252024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
61262024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
61272024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61282024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
61292024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
61302024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
61312024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61322024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
61332024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
61342024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
61352024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61362024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
61372024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61382024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
61392024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61402024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61412024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
61422024-12-20T21:36:19.540ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 21:26:19.540901022 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
61432024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
61442024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
61452024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
61462024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
61472024-12-20T21:36:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61482024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
61492024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61502024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
61512024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
61522024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
61532024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61542024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
61552024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61562024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61572024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61582024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61592024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61602024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61612024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61622024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61632024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
61642024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61652024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61662024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61672024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61682024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61692024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
61702024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
61712024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
61722024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61732024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61742024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
61752024-12-20T21:36:19.541ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4565f09e-ee63-469d-bb6e-3ccd4abd01fe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("73abfaca-4f35-4f97-9980-1890d6dba8fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3f6b067-d10e-44b3-9f21-f8e5a96a2b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3f6b067-d10e-44b3-9f21-f8e5a96a2b37.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1678, tv_nsec: 819557526 } })
61762024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
61772024-12-20T21:36:19.541ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("065cea45-0eca-4287-90a0-2c3c20ec32f8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b24cb173-c3a3-4237-abe6-0e7953a415e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b24cb173-c3a3-4237-abe6-0e7953a415e5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1678, tv_nsec: 819584366 } })
61782024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
61792024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61802024-12-20T21:36:19.541ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
61812024-12-20T21:36:19.542ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.330509ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
61822024-12-20T21:36:19.542ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
61832024-12-20T21:36:19.542ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.239197ms iteration = 15 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
61842024-12-20T21:36:19.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61852024-12-20T21:36:19.543ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61862024-12-20T21:36:19.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61872024-12-20T21:36:19.543ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61882024-12-20T21:36:19.544ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61892024-12-20T21:36:19.545ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.149663ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
61902024-12-20T21:36:19.545ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61912024-12-20T21:36:19.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
61922024-12-20T21:36:19.546ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61932024-12-20T21:36:19.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61942024-12-20T21:36:19.546ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
61952024-12-20T21:36:19.546ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61962024-12-20T21:36:19.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61972024-12-20T21:36:19.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
61982024-12-20T21:36:19.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61992024-12-20T21:36:19.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62002024-12-20T21:36:19.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62012024-12-20T21:36:19.548ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62022024-12-20T21:36:19.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62032024-12-20T21:36:19.548ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62042024-12-20T21:36:19.549ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62052024-12-20T21:36:19.549ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62062024-12-20T21:36:19.550ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62072024-12-20T21:36:19.550ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62082024-12-20T21:36:19.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62092024-12-20T21:36:19.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62102024-12-20T21:36:19.551ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62112024-12-20T21:36:19.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62122024-12-20T21:36:19.552ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62132024-12-20T21:36:19.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62142024-12-20T21:36:19.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62152024-12-20T21:36:19.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62162024-12-20T21:36:19.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62172024-12-20T21:36:19.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62182024-12-20T21:36:19.553ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62192024-12-20T21:36:19.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62202024-12-20T21:36:19.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62212024-12-20T21:36:19.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62222024-12-20T21:36:19.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62232024-12-20T21:36:19.555ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1678, tv_nsec: 833326205 } })
62242024-12-20T21:36:19.555ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
62252024-12-20T21:36:19.555ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.668148ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
62262024-12-20T21:36:19.557ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1678, tv_nsec: 835485943 } })
62272024-12-20T21:36:19.557ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
62282024-12-20T21:36:19.557ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.148165ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
62292024-12-20T21:36:19.558ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62302024-12-20T21:36:19.558ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
62312024-12-20T21:36:19.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62322024-12-20T21:36:19.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62332024-12-20T21:36:19.559ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 21:26:19.540901022 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
62342024-12-20T21:36:19.559ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.517406ms iteration = 15 status = {"expiration":"2024-12-20T21:26:19.540901022Z","pruned":[]}
62352024-12-20T21:36:19.560ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
62362024-12-20T21:36:19.560ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
62372024-12-20T21:36:19.560ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 19.075057ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
62382024-12-20T21:36:19.561ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62392024-12-20T21:36:19.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62402024-12-20T21:36:19.562ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62412024-12-20T21:36:19.562ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1678, tv_nsec: 840824563 } })
62422024-12-20T21:36:19.562ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62432024-12-20T21:36:19.563ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
62442024-12-20T21:36:19.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62452024-12-20T21:36:19.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62462024-12-20T21:36:19.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62472024-12-20T21:36:19.564ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62482024-12-20T21:36:19.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62492024-12-20T21:36:19.566ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62502024-12-20T21:36:19.566ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62512024-12-20T21:36:19.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62522024-12-20T21:36:19.568ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62532024-12-20T21:36:19.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62542024-12-20T21:36:19.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62552024-12-20T21:36:19.570ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62562024-12-20T21:36:19.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62572024-12-20T21:36:19.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
62582024-12-20T21:36:19.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62592024-12-20T21:36:19.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62602024-12-20T21:36:19.587ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62612024-12-20T21:36:19.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62622024-12-20T21:36:19.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62632024-12-20T21:36:19.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62642024-12-20T21:36:19.590ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62652024-12-20T21:36:19.592ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
62662024-12-20T21:36:19.592ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
62672024-12-20T21:36:19.592ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 51.592767ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
62682024-12-20T21:36:19.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62692024-12-20T21:36:19.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62702024-12-20T21:36:19.594ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 53.301405ms iteration = 29 status = {"errors":[],"finish_invoked_ok":[]}
62712024-12-20T21:36:19.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62722024-12-20T21:36:19.595ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
62732024-12-20T21:36:19.595ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
62742024-12-20T21:36:19.595ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
62752024-12-20T21:36:19.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62762024-12-20T21:36:19.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62772024-12-20T21:36:19.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62782024-12-20T21:36:19.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62792024-12-20T21:36:19.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62802024-12-20T21:36:19.601ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62812024-12-20T21:36:19.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62822024-12-20T21:36:19.602ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
62832024-12-20T21:36:19.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62842024-12-20T21:36:19.602ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.045551ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
62852024-12-20T21:36:19.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62862024-12-20T21:36:19.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62872024-12-20T21:36:19.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62882024-12-20T21:36:19.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c74ff24-982c-40fd-86fd-ef04898c5922, lookup_type: ById(8c74ff24-982c-40fd-86fd-ef04898c5922) } result = Ok(())
62892024-12-20T21:36:19.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62902024-12-20T21:36:19.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62912024-12-20T21:36:19.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62922024-12-20T21:36:19.609ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
62932024-12-20T21:36:19.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62942024-12-20T21:36:19.609ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.524587ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
62952024-12-20T21:36:19.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62962024-12-20T21:36:19.611ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62972024-12-20T21:36:19.611ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
62982024-12-20T21:36:19.611ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62992024-12-20T21:36:19.611ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 70.627334ms iteration = 29 status = 0
63002024-12-20T21:36:19.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 70.615654ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63012024-12-20T21:36:19.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63022024-12-20T21:36:19.611ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63032024-12-20T21:36:19.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63042024-12-20T21:36:19.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
63052024-12-20T21:36:19.617ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63062024-12-20T21:36:19.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63072024-12-20T21:36:19.625ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
63082024-12-20T21:36:19.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
63092024-12-20T21:36:19.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 101.923366ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63102024-12-20T21:36:19.646ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 105.437524ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63112024-12-20T21:36:19.647ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
63122024-12-20T21:36:19.647ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c58feff7-51f2-445e-83fd-a0c3a102f4ed dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
63132024-12-20T21:36:19.647ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
63142024-12-20T21:36:19.647ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
63152024-12-20T21:36:19.647ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
63162024-12-20T21:36:19.647ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63172024-12-20T21:36:19.647ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63182024-12-20T21:36:19.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63192024-12-20T21:36:19.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63202024-12-20T21:36:19.649ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63212024-12-20T21:36:19.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63222024-12-20T21:36:19.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63232024-12-20T21:36:19.653ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63242024-12-20T21:36:19.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63252024-12-20T21:36:19.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63262024-12-20T21:36:19.653ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63272024-12-20T21:36:19.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63282024-12-20T21:36:19.654ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 113.627468ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
63292024-12-20T21:36:19.656ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63302024-12-20T21:36:19.656ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c58feff7-51f2-445e-83fd-a0c3a102f4ed dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
63312024-12-20T21:36:19.656ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
63322024-12-20T21:36:19.656ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 21:23:04.517297 UTC dns_group = internal generation = 1
63332024-12-20T21:36:19.656ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 116.368439ms iteration = 15 status = {"generation":1}
63342024-12-20T21:36:19.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63352024-12-20T21:36:19.660ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63362024-12-20T21:36:19.660ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63372024-12-20T21:36:19.660ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 119.624082ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
63382024-12-20T21:36:19.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63392024-12-20T21:36:19.667ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
63402024-12-20T21:36:19.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63412024-12-20T21:36:19.685ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
63422024-12-20T21:36:19.686ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
63432024-12-20T21:36:19.686ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4aec9cd8-ad86-40dc-bdd7-2394e3237b38 dns_zone_name = oxide.test found_so_far = 0 version = 2
63442024-12-20T21:36:19.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63452024-12-20T21:36:19.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63462024-12-20T21:36:19.689ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 148.807847ms iteration = 32 status = {"physical_disks_added":0}
63472024-12-20T21:36:19.712ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
63482024-12-20T21:36:19.712ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63492024-12-20T21:36:19.712ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2d43224-5767-43e2-9d5a-775a0280b4e6", "content-length": "26", "date": "Fri, 20 Dec 2024 21:36:19 GMT"} })
63502024-12-20T21:36:19.712ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63512024-12-20T21:36:19.713ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63522024-12-20T21:36:19.715ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
63532024-12-20T21:36:19.715ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 174.608125ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
63542024-12-20T21:36:19.747ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac zone_address = fd00:1122:3344:101::2
63552024-12-20T21:36:19.747ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63562024-12-20T21:36:19.747ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
63572024-12-20T21:36:19.747ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63582024-12-20T21:36:19.747ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "98024b44-5e5e-4b30-96c3-e36351139cb6", "content-length": "26", "date": "Fri, 20 Dec 2024 21:36:19 GMT"} })
63592024-12-20T21:36:19.747ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63602024-12-20T21:36:19.747ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "696d3e15-a08c-422e-af78-dfa650c4fd05", "content-length": "26", "date": "Fri, 20 Dec 2024 21:36:19 GMT"} })
63612024-12-20T21:36:19.747ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63622024-12-20T21:36:19.749ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63632024-12-20T21:36:19.749ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
63642024-12-20T21:36:19.820ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
63652024-12-20T21:36:19.886ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
63662024-12-20T21:36:19.886ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c975c815-eb14-4ec5-b8d2-b83e25e1f522", "content-length": "2", "date": "Fri, 20 Dec 2024 21:36:18 GMT"} })
63672024-12-20T21:36:19.887ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63682024-12-20T21:36:19.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63692024-12-20T21:36:19.924ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 383.893437ms iteration = 29 status = {}
63702024-12-20T21:36:19.956ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
63712024-12-20T21:36:19.956ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63722024-12-20T21:36:19.957ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f6d9f87-e7ac-420c-989b-85aa6a012492", "content-length": "372", "date": "Fri, 20 Dec 2024 21:36:19 GMT"} })
63732024-12-20T21:36:19.957ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63742024-12-20T21:36:19.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63752024-12-20T21:36:19.960ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63762024-12-20T21:36:19.960ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 419.589778ms iteration = 29 status = null
63772024-12-20T21:36:19.963ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63782024-12-20T21:36:19.963ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63792024-12-20T21:36:19.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63802024-12-20T21:36:19.965ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4aec9cd8-ad86-40dc-bdd7-2394e3237b38 dns_zone_name = oxide.test found_so_far = 1 version = 2
63812024-12-20T21:36:19.965ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
63822024-12-20T21:36:19.965ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 21:23:05.526309 UTC dns_group = external generation = 2
63832024-12-20T21:36:19.965ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 424.509798ms iteration = 15 status = {"generation":2}
63842024-12-20T21:36:19.966ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
63852024-12-20T21:36:19.967ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "20ea835d-1819-49f1-bf3f-cd147a6efab1", "date": "Fri, 20 Dec 2024 21:36:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
63862024-12-20T21:36:19.967ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
63872024-12-20T21:36:19.968ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7331d486-7587-4173-8cb7-77fb1458f585", "date": "Fri, 20 Dec 2024 21:36:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
63882024-12-20T21:36:19.968ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
63892024-12-20T21:36:19.970ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
63902024-12-20T21:36:19.970ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 429.480819ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
63912024-12-20T21:36:19.970ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
63922024-12-20T21:36:19.970ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1f072883-3038-4c6c-a45c-7411e1be0e53", "date": "Fri, 20 Dec 2024 21:36:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
63932024-12-20T21:36:19.971ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
63942024-12-20T21:36:19.972ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b1ff3f66-6627-4d3f-b176-3769ffb80b1d", "date": "Fri, 20 Dec 2024 21:36:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
63952024-12-20T21:36:19.972ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
63962024-12-20T21:36:19.974ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e4bf1704-e905-4627-80de-11d7e2ea7347", "date": "Fri, 20 Dec 2024 21:36:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
63972024-12-20T21:36:19.974ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
63982024-12-20T21:36:19.976ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
63992024-12-20T21:36:19.976ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 435.762131ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
64002024-12-20T21:36:19.991ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64012024-12-20T21:36:19.993ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
64022024-12-20T21:36:19.993ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64032024-12-20T21:36:19.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64042024-12-20T21:36:20.007ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
64052024-12-20T21:36:20.007ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
64062024-12-20T21:36:20.008ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "375ee4cc-809a-45e7-9f74-edb5fdaa960b", "date": "Fri, 20 Dec 2024 21:36:19 GMT"} })
64072024-12-20T21:36:20.008ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64082024-12-20T21:36:20.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64092024-12-20T21:36:20.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d52bd987-586d-4c6f-a4db-8b1edc96331c roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
64102024-12-20T21:36:20.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d52bd987-586d-4c6f-a4db-8b1edc96331c resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
64112024-12-20T21:36:20.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64122024-12-20T21:36:20.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64132024-12-20T21:36:20.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d52bd987-586d-4c6f-a4db-8b1edc96331c response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
64142024-12-20T21:36:20.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64152024-12-20T21:36:20.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64162024-12-20T21:36:20.018ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
64172024-12-20T21:36:20.018ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64182024-12-20T21:36:20.019ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cfc2d1a1-ba61-4644-ab8c-1d9502350122", "date": "Fri, 20 Dec 2024 21:36:19 GMT"} })
64192024-12-20T21:36:20.021ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 481.018065ms iteration = 30 status = {}
64202024-12-20T21:36:20.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64212024-12-20T21:36:20.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64222024-12-20T21:36:20.036ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 583388f4-92af-4a10-817c-62f2e9571310, rack_id: a7e68df9-95f5-4fda-aae0-2f46483e29ac, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bacaa666-9eda-4bc8-9ccd-35df228fd476) } rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
64232024-12-20T21:36:20.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64242024-12-20T21:36:20.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64252024-12-20T21:36:20.037ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T21:22:10.640928Z, time_modified: 2024-12-20T21:22:10.640928Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, db_silo: Silo { identity: SiloIdentity { id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T21:23:05.471312Z, time_modified: 2024-12-20T21:23:05.471312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, db_silo: Silo { identity: SiloIdentity { id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T21:23:05.471312Z, time_modified: 2024-12-20T21:23:05.471312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b" }] }) }
64262024-12-20T21:36:20.037ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 496.85683ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"66e8bce1-b95a-4433-886f-e35fda6d9a14","tls_certs":["4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b"]}},"default_endpoint":{"silo_id":"66e8bce1-b95a-4433-886f-e35fda6d9a14","tls_certs":["4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
64272024-12-20T21:36:20.046ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64282024-12-20T21:36:20.047ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8447fcfc-df11-479d-add5-aa8c55edd9c4", "content-length": "134", "date": "Fri, 20 Dec 2024 21:36:19 GMT"} })
64292024-12-20T21:36:20.047ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
64302024-12-20T21:36:20.047ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bacaa666-9eda-4bc8-9ccd-35df228fd476
64312024-12-20T21:36:20.047ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
64322024-12-20T21:36:20.047ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64332024-12-20T21:36:20.047ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64342024-12-20T21:36:20.047ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64352024-12-20T21:36:20.047ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64362024-12-20T21:36:20.047ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64372024-12-20T21:36:20.047ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64382024-12-20T21:36:20.047ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64392024-12-20T21:36:20.048ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
64402024-12-20T21:36:20.048ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64412024-12-20T21:36:20.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64422024-12-20T21:36:20.050ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
64432024-12-20T21:36:20.050ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d46a51c-dc0c-4547-a187-446643dee0c3", "content-length": "2", "date": "Fri, 20 Dec 2024 21:36:19 GMT"} })
64442024-12-20T21:36:20.050ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
64452024-12-20T21:36:20.050ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "28132931-2aa1-4c64-93d8-ab600ee538ad", "content-length": "52", "date": "Fri, 20 Dec 2024 21:36:19 GMT"} })
64462024-12-20T21:36:20.050ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
64472024-12-20T21:36:20.050ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64482024-12-20T21:36:20.058ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64492024-12-20T21:36:20.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64502024-12-20T21:36:20.059ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64512024-12-20T21:36:20.061ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64522024-12-20T21:36:20.061ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64532024-12-20T21:36:20.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64542024-12-20T21:36:20.063ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64552024-12-20T21:36:20.065ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64562024-12-20T21:36:20.065ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64572024-12-20T21:36:20.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64582024-12-20T21:36:20.101ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
64592024-12-20T21:36:20.148ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6c24c330-6172-4b39-bdcd-7439b66003f0", "date": "Fri, 20 Dec 2024 21:36:19 GMT"} })
64602024-12-20T21:36:20.148ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch = Switch0
64612024-12-20T21:36:20.148ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64622024-12-20T21:36:20.149ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ecb86d9-87c7-4906-8166-b3044c3f0b79", "content-length": "682", "date": "Fri, 20 Dec 2024 21:36:19 GMT"} })
64632024-12-20T21:36:20.149ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64642024-12-20T21:36:20.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64652024-12-20T21:36:20.149ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f2ed562-2c16-41f5-aa91-632700f56625", "content-length": "691", "date": "Fri, 20 Dec 2024 21:36:20 GMT"} })
64662024-12-20T21:36:20.149ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
64672024-12-20T21:36:20.149ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
64682024-12-20T21:36:20.149ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
64692024-12-20T21:36:20.152ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 611.367608ms iteration = 30 status = {}
64702024-12-20T21:36:20.153ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64712024-12-20T21:36:20.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64722024-12-20T21:36:20.157ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64732024-12-20T21:36:20.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64742024-12-20T21:36:20.159ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64752024-12-20T21:36:20.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64762024-12-20T21:36:20.167ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 626.792164ms iteration = 29 status = {}
64772024-12-20T21:36:21.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0fbffebf-d824-4190-96b7-bd996ab96122 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
64782024-12-20T21:36:21.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0fbffebf-d824-4190-96b7-bd996ab96122 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
64792024-12-20T21:36:21.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0fbffebf-d824-4190-96b7-bd996ab96122 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
64802024-12-20T21:36:22.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 32deafde-b131-400d-9494-27e23c3848a9 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
64812024-12-20T21:36:22.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 32deafde-b131-400d-9494-27e23c3848a9 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
64822024-12-20T21:36:22.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 32deafde-b131-400d-9494-27e23c3848a9 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
64832024-12-20T21:36:23.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 32c3306e-ef0d-40b1-b1b4-1bdbcd267c07 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
64842024-12-20T21:36:23.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 32c3306e-ef0d-40b1-b1b4-1bdbcd267c07 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
64852024-12-20T21:36:23.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2979 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 32c3306e-ef0d-40b1-b1b4-1bdbcd267c07 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
64862024-12-20T21:36:24.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5af766a3-3640-4ef2-acb2-1da102678708 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
64872024-12-20T21:36:24.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5af766a3-3640-4ef2-acb2-1da102678708 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
64882024-12-20T21:36:24.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2899 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5af766a3-3640-4ef2-acb2-1da102678708 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
64892024-12-20T21:36:25.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 066747a1-947e-49bc-9199-e4bc6ff82613 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
64902024-12-20T21:36:25.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 066747a1-947e-49bc-9199-e4bc6ff82613 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
64912024-12-20T21:36:25.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 066747a1-947e-49bc-9199-e4bc6ff82613 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
64922024-12-20T21:36:26.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 87c94a35-6f3f-45b6-8bd5-abb8e04e048e roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
64932024-12-20T21:36:26.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 87c94a35-6f3f-45b6-8bd5-abb8e04e048e resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
64942024-12-20T21:36:26.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2531 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 87c94a35-6f3f-45b6-8bd5-abb8e04e048e response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
64952024-12-20T21:36:26.400ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:60480
64962024-12-20T21:36:26.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60480 req_id = f490495e-759f-4a20-b367-2acbbff92569 roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
64972024-12-20T21:36:26.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60480 req_id = f490495e-759f-4a20-b367-2acbbff92569 resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
64982024-12-20T21:36:26.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60480 req_id = f490495e-759f-4a20-b367-2acbbff92569 response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
64992024-12-20T21:36:26.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60480 req_id = a26d0b12-6ea8-414f-b537-1e7ccc522ea5 roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
65002024-12-20T21:36:26.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60480 req_id = a26d0b12-6ea8-414f-b537-1e7ccc522ea5 resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
65012024-12-20T21:36:26.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60480 req_id = a26d0b12-6ea8-414f-b537-1e7ccc522ea5 response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
65022024-12-20T21:36:26.407ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 589 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 2ce70b34-72c8-4029-8fa7-cdd3eb4712a9 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
65032024-12-20T21:36:27.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ff285357-fb1c-4829-a781-132e13b819e8 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65042024-12-20T21:36:27.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ff285357-fb1c-4829-a781-132e13b819e8 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65052024-12-20T21:36:27.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ff285357-fb1c-4829-a781-132e13b819e8 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65062024-12-20T21:36:28.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8d96fc16-07a8-4d1b-8298-e2d4dccdaf7b roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65072024-12-20T21:36:28.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8d96fc16-07a8-4d1b-8298-e2d4dccdaf7b resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65082024-12-20T21:36:28.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8d96fc16-07a8-4d1b-8298-e2d4dccdaf7b response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65092024-12-20T21:36:29.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6784522d-aa33-447b-94b0-f3d1a1c9db74 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65102024-12-20T21:36:29.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6784522d-aa33-447b-94b0-f3d1a1c9db74 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65112024-12-20T21:36:29.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6784522d-aa33-447b-94b0-f3d1a1c9db74 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65122024-12-20T21:36:29.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
65132024-12-20T21:36:29.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
65142024-12-20T21:36:29.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65152024-12-20T21:36:29.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65162024-12-20T21:36:29.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65172024-12-20T21:36:29.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65182024-12-20T21:36:29.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65192024-12-20T21:36:29.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65202024-12-20T21:36:29.546ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.306759ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65212024-12-20T21:36:29.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65222024-12-20T21:36:29.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65232024-12-20T21:36:29.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65242024-12-20T21:36:29.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65252024-12-20T21:36:29.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65262024-12-20T21:36:29.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65272024-12-20T21:36:29.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65282024-12-20T21:36:29.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
65292024-12-20T21:36:29.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65302024-12-20T21:36:29.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65312024-12-20T21:36:29.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
65322024-12-20T21:36:29.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.323863ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
65332024-12-20T21:36:30.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 94aa2a4a-5a7c-4c1f-bc05-54158b73782d roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65342024-12-20T21:36:30.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 94aa2a4a-5a7c-4c1f-bc05-54158b73782d resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65352024-12-20T21:36:30.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 94aa2a4a-5a7c-4c1f-bc05-54158b73782d response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65362024-12-20T21:36:31.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f6c2c07a-1a99-402e-b5ba-c7762ace7d87 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65372024-12-20T21:36:31.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f6c2c07a-1a99-402e-b5ba-c7762ace7d87 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65382024-12-20T21:36:31.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f6c2c07a-1a99-402e-b5ba-c7762ace7d87 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65392024-12-20T21:36:32.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8f25aea0-bbe7-46f3-897d-b29fb6e2a0e7 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65402024-12-20T21:36:32.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8f25aea0-bbe7-46f3-897d-b29fb6e2a0e7 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65412024-12-20T21:36:32.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8f25aea0-bbe7-46f3-897d-b29fb6e2a0e7 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65422024-12-20T21:36:33.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d013a377-f5dc-4c29-bf58-a507604450e6 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65432024-12-20T21:36:33.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d013a377-f5dc-4c29-bf58-a507604450e6 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65442024-12-20T21:36:33.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d013a377-f5dc-4c29-bf58-a507604450e6 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65452024-12-20T21:36:34.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 69aa00e0-8584-4d69-9fb6-9eb0af04d3b6 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65462024-12-20T21:36:34.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 69aa00e0-8584-4d69-9fb6-9eb0af04d3b6 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65472024-12-20T21:36:34.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 69aa00e0-8584-4d69-9fb6-9eb0af04d3b6 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65482024-12-20T21:36:35.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ae82db91-6df4-4b9b-9c53-ec968e1253b9 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65492024-12-20T21:36:35.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ae82db91-6df4-4b9b-9c53-ec968e1253b9 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65502024-12-20T21:36:35.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1841 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ae82db91-6df4-4b9b-9c53-ec968e1253b9 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65512024-12-20T21:36:36.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 10ce505a-f046-42ae-b513-01dc5e0a335d roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65522024-12-20T21:36:36.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 10ce505a-f046-42ae-b513-01dc5e0a335d resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65532024-12-20T21:36:36.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2793 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 10ce505a-f046-42ae-b513-01dc5e0a335d response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65542024-12-20T21:36:36.407ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 697 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 4243ffe0-772b-4c70-8485-dca9fa979545 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
65552024-12-20T21:36:37.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2d9551e1-673b-4955-97b6-c482ce9cba88 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65562024-12-20T21:36:37.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2d9551e1-673b-4955-97b6-c482ce9cba88 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65572024-12-20T21:36:37.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2589 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2d9551e1-673b-4955-97b6-c482ce9cba88 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65582024-12-20T21:36:38.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0146019e-f510-4ada-889d-02e907cbf8c8 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65592024-12-20T21:36:38.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0146019e-f510-4ada-889d-02e907cbf8c8 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65602024-12-20T21:36:38.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0146019e-f510-4ada-889d-02e907cbf8c8 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65612024-12-20T21:36:39.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f1e77578-7980-4e26-ac72-4e9ac576b73a roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65622024-12-20T21:36:39.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f1e77578-7980-4e26-ac72-4e9ac576b73a resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65632024-12-20T21:36:39.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f1e77578-7980-4e26-ac72-4e9ac576b73a response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65642024-12-20T21:36:39.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
65652024-12-20T21:36:39.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
65662024-12-20T21:36:39.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65672024-12-20T21:36:39.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65682024-12-20T21:36:39.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65692024-12-20T21:36:39.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65702024-12-20T21:36:39.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65712024-12-20T21:36:39.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65722024-12-20T21:36:39.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65732024-12-20T21:36:39.571ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.892483ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65742024-12-20T21:36:39.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65752024-12-20T21:36:39.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65762024-12-20T21:36:39.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65772024-12-20T21:36:39.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65782024-12-20T21:36:39.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65792024-12-20T21:36:39.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65802024-12-20T21:36:39.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
65812024-12-20T21:36:39.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65822024-12-20T21:36:39.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65832024-12-20T21:36:39.590ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
65842024-12-20T21:36:39.590ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.214726ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
65852024-12-20T21:36:40.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3c00a784-f518-4905-a6f5-51b3b2e695e1 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65862024-12-20T21:36:40.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3c00a784-f518-4905-a6f5-51b3b2e695e1 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65872024-12-20T21:36:40.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3c00a784-f518-4905-a6f5-51b3b2e695e1 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65882024-12-20T21:36:41.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60480 req_id = 15fc28c8-d528-4fc7-8d4e-84cef0b05e4f roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
65892024-12-20T21:36:41.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60480 req_id = 15fc28c8-d528-4fc7-8d4e-84cef0b05e4f resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
65902024-12-20T21:36:41.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60480 req_id = 15fc28c8-d528-4fc7-8d4e-84cef0b05e4f response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
65912024-12-20T21:36:41.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60480 req_id = f3ea2e86-db42-48a6-97ee-644ffbca5c84 roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
65922024-12-20T21:36:41.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60480 req_id = f3ea2e86-db42-48a6-97ee-644ffbca5c84 resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
65932024-12-20T21:36:41.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2550 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60480 req_id = f3ea2e86-db42-48a6-97ee-644ffbca5c84 response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
65942024-12-20T21:36:41.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6b88f4fc-3813-432d-a179-6ca304db2e50 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65952024-12-20T21:36:41.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6b88f4fc-3813-432d-a179-6ca304db2e50 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65962024-12-20T21:36:41.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6b88f4fc-3813-432d-a179-6ca304db2e50 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65972024-12-20T21:36:42.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c4941f18-d397-4c4d-96a8-3930cb32d720 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65982024-12-20T21:36:42.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c4941f18-d397-4c4d-96a8-3930cb32d720 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
65992024-12-20T21:36:42.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c4941f18-d397-4c4d-96a8-3930cb32d720 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
66002024-12-20T21:36:43.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9776bc1d-eee1-4f4a-9abb-cca2856f9dda roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
66012024-12-20T21:36:43.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9776bc1d-eee1-4f4a-9abb-cca2856f9dda resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
66022024-12-20T21:36:43.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9776bc1d-eee1-4f4a-9abb-cca2856f9dda response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
66032024-12-20T21:36:44.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7c8065f2-64e3-4eaf-93a1-c60efc8817dc roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
66042024-12-20T21:36:44.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7c8065f2-64e3-4eaf-93a1-c60efc8817dc resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
66052024-12-20T21:36:44.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7c8065f2-64e3-4eaf-93a1-c60efc8817dc response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
66062024-12-20T21:36:45.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2ec51fc7-e606-4536-9b6d-0b09f0b111f1 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
66072024-12-20T21:36:45.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2ec51fc7-e606-4536-9b6d-0b09f0b111f1 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
66082024-12-20T21:36:45.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2ec51fc7-e606-4536-9b6d-0b09f0b111f1 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
66092024-12-20T21:36:46.407ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 866 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = f7f4866c-46d6-443e-846d-bc898049ef98 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
66102024-12-20T21:36:46.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 79697cca-ea0e-4f9b-87e9-19b12d93ef81 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
66112024-12-20T21:36:46.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 79697cca-ea0e-4f9b-87e9-19b12d93ef81 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
66122024-12-20T21:36:46.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 79697cca-ea0e-4f9b-87e9-19b12d93ef81 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
66132024-12-20T21:36:46.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 22591c04-054c-42e4-af12-0bc9f9dde67c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
66142024-12-20T21:36:46.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 22591c04-054c-42e4-af12-0bc9f9dde67c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
66152024-12-20T21:36:46.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 22591c04-054c-42e4-af12-0bc9f9dde67c response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
66162024-12-20T21:36:47.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cd80335f-529f-4801-b9b2-f02caca072e5 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
66172024-12-20T21:36:47.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cd80335f-529f-4801-b9b2-f02caca072e5 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
66182024-12-20T21:36:47.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2629 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cd80335f-529f-4801-b9b2-f02caca072e5 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
66192024-12-20T21:36:48.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 678b690b-3619-4e03-a26d-20db4ad4568e roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
66202024-12-20T21:36:48.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 678b690b-3619-4e03-a26d-20db4ad4568e resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
66212024-12-20T21:36:48.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2801 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 678b690b-3619-4e03-a26d-20db4ad4568e response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
66222024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
66232024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
66242024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66252024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66262024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
66272024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
66282024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66292024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
66302024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66312024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
66322024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
66332024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
66342024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66352024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
66362024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
66372024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
66382024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66392024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66402024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
66412024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
66422024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
66432024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66442024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
66452024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
66462024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
66472024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66482024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
66492024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66502024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
66512024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66522024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
66532024-12-20T21:36:49.540ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
66542024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66552024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
66562024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66572024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66582024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66592024-12-20T21:36:49.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66602024-12-20T21:36:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66612024-12-20T21:36:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
66622024-12-20T21:36:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66632024-12-20T21:36:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66642024-12-20T21:36:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
66652024-12-20T21:36:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66662024-12-20T21:36:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
66672024-12-20T21:36:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66682024-12-20T21:36:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66692024-12-20T21:36:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66702024-12-20T21:36:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66712024-12-20T21:36:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66722024-12-20T21:36:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66732024-12-20T21:36:49.543ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66742024-12-20T21:36:49.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66752024-12-20T21:36:49.544ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.076852ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
66762024-12-20T21:36:49.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66772024-12-20T21:36:49.545ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66782024-12-20T21:36:49.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66792024-12-20T21:36:49.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
66802024-12-20T21:36:49.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66812024-12-20T21:36:49.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66822024-12-20T21:36:49.547ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1708, tv_nsec: 825049143 } })
66832024-12-20T21:36:49.547ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
66842024-12-20T21:36:49.548ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66852024-12-20T21:36:49.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66862024-12-20T21:36:49.549ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1708, tv_nsec: 827140710 } })
66872024-12-20T21:36:49.549ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
66882024-12-20T21:36:49.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
66892024-12-20T21:36:49.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66902024-12-20T21:36:49.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66912024-12-20T21:36:49.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66922024-12-20T21:36:49.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66932024-12-20T21:36:49.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66942024-12-20T21:36:49.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66952024-12-20T21:36:49.559ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66962024-12-20T21:36:49.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66972024-12-20T21:36:49.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66982024-12-20T21:36:49.562ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1708, tv_nsec: 840182242 } })
66992024-12-20T21:36:49.562ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67002024-12-20T21:36:49.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67012024-12-20T21:36:49.562ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
67022024-12-20T21:36:49.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67032024-12-20T21:36:49.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67042024-12-20T21:36:49.565ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67052024-12-20T21:36:49.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67062024-12-20T21:36:49.567ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67072024-12-20T21:36:49.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67082024-12-20T21:36:49.569ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67092024-12-20T21:36:49.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67102024-12-20T21:36:49.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67112024-12-20T21:36:49.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67122024-12-20T21:36:49.581ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67132024-12-20T21:36:49.581ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
67142024-12-20T21:36:49.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67152024-12-20T21:36:49.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67162024-12-20T21:36:49.582ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67172024-12-20T21:36:49.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67182024-12-20T21:36:49.585ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 44.914937ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
67192024-12-20T21:36:49.587ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.578975ms iteration = 30 status = {"errors":[],"finish_invoked_ok":[]}
67202024-12-20T21:36:49.589ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67212024-12-20T21:36:49.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67222024-12-20T21:36:49.591ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67232024-12-20T21:36:49.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67242024-12-20T21:36:49.593ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67252024-12-20T21:36:49.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67262024-12-20T21:36:49.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
67272024-12-20T21:36:49.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67282024-12-20T21:36:49.595ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67292024-12-20T21:36:49.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67302024-12-20T21:36:49.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67312024-12-20T21:36:49.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67322024-12-20T21:36:49.597ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67332024-12-20T21:36:49.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67342024-12-20T21:36:49.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67352024-12-20T21:36:49.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
67362024-12-20T21:36:49.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67372024-12-20T21:36:49.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67382024-12-20T21:36:49.604ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
67392024-12-20T21:36:49.604ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.940394ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
67402024-12-20T21:36:49.614ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 74.48241ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
67412024-12-20T21:36:49.614ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 74.625184ms iteration = 33 status = {"physical_disks_added":0}
67422024-12-20T21:36:49.616ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
67432024-12-20T21:36:49.616ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 75.79198ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
67442024-12-20T21:36:49.616ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67452024-12-20T21:36:49.616ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
67462024-12-20T21:36:49.616ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67472024-12-20T21:36:49.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67482024-12-20T21:36:49.619ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 78.885829ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67492024-12-20T21:36:49.619ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
67502024-12-20T21:36:49.619ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67512024-12-20T21:36:49.619ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cee2dbd-fb6f-45ff-a14c-54bf2772f075", "content-length": "26", "date": "Fri, 20 Dec 2024 21:36:48 GMT"} })
67522024-12-20T21:36:49.619ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67532024-12-20T21:36:49.620ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67542024-12-20T21:36:49.620ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
67552024-12-20T21:36:49.620ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67562024-12-20T21:36:49.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67572024-12-20T21:36:49.620ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "face6efb-e933-4e0d-b5ef-45b2da81dff7", "content-length": "26", "date": "Fri, 20 Dec 2024 21:36:48 GMT"} })
67582024-12-20T21:36:49.620ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67592024-12-20T21:36:49.621ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67602024-12-20T21:36:49.622ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67612024-12-20T21:36:49.623ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 83.064642ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
67622024-12-20T21:36:49.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67632024-12-20T21:36:49.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67642024-12-20T21:36:49.627ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67652024-12-20T21:36:49.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67662024-12-20T21:36:49.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3c32c1db-dd02-42f5-acee-b43b3df653b6 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
67672024-12-20T21:36:49.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3c32c1db-dd02-42f5-acee-b43b3df653b6 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
67682024-12-20T21:36:49.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3c32c1db-dd02-42f5-acee-b43b3df653b6 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
67692024-12-20T21:36:49.648ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 108.304468ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
67702024-12-20T21:36:49.653ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67712024-12-20T21:36:49.653ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
67722024-12-20T21:36:49.653ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 113.370483ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
67732024-12-20T21:36:49.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67742024-12-20T21:36:49.656ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac zone_address = fd00:1122:3344:101::2
67752024-12-20T21:36:49.656ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67762024-12-20T21:36:49.656ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab9972f3-a13a-4b69-9a5a-9c932205633c", "content-length": "26", "date": "Fri, 20 Dec 2024 21:36:48 GMT"} })
67772024-12-20T21:36:49.656ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67782024-12-20T21:36:49.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c74ff24-982c-40fd-86fd-ef04898c5922, lookup_type: ById(8c74ff24-982c-40fd-86fd-ef04898c5922) } result = Ok(())
67792024-12-20T21:36:49.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67802024-12-20T21:36:49.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67812024-12-20T21:36:49.657ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
67822024-12-20T21:36:49.658ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 117.576867ms iteration = 30 status = 0
67832024-12-20T21:36:49.671ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67842024-12-20T21:36:49.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67852024-12-20T21:36:49.715ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
67862024-12-20T21:36:49.715ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "05a35450-4ca7-4a38-b7a1-a4dda4fc3063", "content-length": "2", "date": "Fri, 20 Dec 2024 21:36:48 GMT"} })
67872024-12-20T21:36:49.717ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67882024-12-20T21:36:49.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67892024-12-20T21:36:49.719ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 179.518856ms iteration = 30 status = {}
67902024-12-20T21:36:49.749ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
67912024-12-20T21:36:49.749ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67922024-12-20T21:36:49.749ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b89c05f6-e248-48bc-978c-c7ea1f0e94a8", "content-length": "372", "date": "Fri, 20 Dec 2024 21:36:49 GMT"} })
67932024-12-20T21:36:49.749ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67942024-12-20T21:36:49.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67952024-12-20T21:36:49.751ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 211.521493ms iteration = 30 status = null
67962024-12-20T21:36:49.777ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67972024-12-20T21:36:49.779ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67982024-12-20T21:36:49.779ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67992024-12-20T21:36:49.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68002024-12-20T21:36:49.796ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
68012024-12-20T21:36:49.796ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
68022024-12-20T21:36:49.796ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b0288cb7-1ab3-4652-af59-9ab54e60f9ef", "date": "Fri, 20 Dec 2024 21:36:49 GMT"} })
68032024-12-20T21:36:49.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68042024-12-20T21:36:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68052024-12-20T21:36:49.798ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68062024-12-20T21:36:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68072024-12-20T21:36:49.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68082024-12-20T21:36:49.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68092024-12-20T21:36:49.805ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
68102024-12-20T21:36:49.805ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68112024-12-20T21:36:49.806ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6c18afd4-789f-47f8-9d1d-15dfa2a2cc56", "date": "Fri, 20 Dec 2024 21:36:49 GMT"} })
68122024-12-20T21:36:49.807ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 267.183441ms iteration = 31 status = {}
68132024-12-20T21:36:49.809ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68142024-12-20T21:36:49.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68152024-12-20T21:36:49.812ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 583388f4-92af-4a10-817c-62f2e9571310, rack_id: a7e68df9-95f5-4fda-aae0-2f46483e29ac, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bacaa666-9eda-4bc8-9ccd-35df228fd476) } rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
68162024-12-20T21:36:49.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68172024-12-20T21:36:49.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68182024-12-20T21:36:49.813ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68192024-12-20T21:36:49.815ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68202024-12-20T21:36:49.815ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68212024-12-20T21:36:49.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68222024-12-20T21:36:49.821ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
68232024-12-20T21:36:49.822ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "75072af4-0c0f-4aca-9b65-bc2a9513f013", "content-length": "134", "date": "Fri, 20 Dec 2024 21:36:49 GMT"} })
68242024-12-20T21:36:49.822ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
68252024-12-20T21:36:49.822ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bacaa666-9eda-4bc8-9ccd-35df228fd476
68262024-12-20T21:36:49.822ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
68272024-12-20T21:36:49.822ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
68282024-12-20T21:36:49.822ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68292024-12-20T21:36:49.822ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68302024-12-20T21:36:49.822ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68312024-12-20T21:36:49.822ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68322024-12-20T21:36:49.822ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68332024-12-20T21:36:49.822ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68342024-12-20T21:36:49.822ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
68352024-12-20T21:36:49.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68362024-12-20T21:36:49.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68372024-12-20T21:36:49.824ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
68382024-12-20T21:36:49.825ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d70aaa9-114e-474a-98be-eb6e8d00735c", "content-length": "2", "date": "Fri, 20 Dec 2024 21:36:49 GMT"} })
68392024-12-20T21:36:49.825ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
68402024-12-20T21:36:49.825ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0bf4140-1d52-4745-8d5b-863358f72fad", "content-length": "52", "date": "Fri, 20 Dec 2024 21:36:49 GMT"} })
68412024-12-20T21:36:49.825ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
68422024-12-20T21:36:49.825ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
68432024-12-20T21:36:49.916ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
68442024-12-20T21:36:49.939ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ac6742fe-aee5-4fdc-901b-7099f090e0db", "date": "Fri, 20 Dec 2024 21:36:49 GMT"} })
68452024-12-20T21:36:49.939ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch = Switch0
68462024-12-20T21:36:49.939ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
68472024-12-20T21:36:49.939ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8cfabe4-6084-425f-84d4-48bd00bc4686", "content-length": "682", "date": "Fri, 20 Dec 2024 21:36:49 GMT"} })
68482024-12-20T21:36:49.939ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68492024-12-20T21:36:49.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68502024-12-20T21:36:49.940ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5defee2-caf4-4f56-9b9a-cac651fe341c", "content-length": "691", "date": "Fri, 20 Dec 2024 21:36:49 GMT"} })
68512024-12-20T21:36:49.940ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
68522024-12-20T21:36:49.940ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
68532024-12-20T21:36:49.940ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
68542024-12-20T21:36:49.941ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 401.336209ms iteration = 31 status = {}
68552024-12-20T21:36:49.943ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68562024-12-20T21:36:49.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68572024-12-20T21:36:49.947ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68582024-12-20T21:36:49.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68592024-12-20T21:36:49.949ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68602024-12-20T21:36:49.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68612024-12-20T21:36:49.956ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 416.212662ms iteration = 30 status = {}
68622024-12-20T21:36:50.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6c6d1076-c9bd-43d7-b281-c5be9faad208 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68632024-12-20T21:36:50.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6c6d1076-c9bd-43d7-b281-c5be9faad208 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68642024-12-20T21:36:50.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2632 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6c6d1076-c9bd-43d7-b281-c5be9faad208 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68652024-12-20T21:36:51.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 81e53be7-3f62-437f-b0f4-f76a236baa35 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68662024-12-20T21:36:51.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 81e53be7-3f62-437f-b0f4-f76a236baa35 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68672024-12-20T21:36:51.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2569 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 81e53be7-3f62-437f-b0f4-f76a236baa35 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68682024-12-20T21:36:52.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 93bad8c5-9797-4429-a1f8-4254451b66f1 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68692024-12-20T21:36:52.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 93bad8c5-9797-4429-a1f8-4254451b66f1 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68702024-12-20T21:36:52.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2823 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 93bad8c5-9797-4429-a1f8-4254451b66f1 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68712024-12-20T21:36:53.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e8140310-abe5-4d56-b6c8-72d29db7ce5d roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68722024-12-20T21:36:53.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e8140310-abe5-4d56-b6c8-72d29db7ce5d resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68732024-12-20T21:36:53.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2681 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e8140310-abe5-4d56-b6c8-72d29db7ce5d response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68742024-12-20T21:36:54.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 83aaa2ec-b8e1-482e-af4c-2e371b2d3fc8 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68752024-12-20T21:36:54.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 83aaa2ec-b8e1-482e-af4c-2e371b2d3fc8 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68762024-12-20T21:36:54.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 83aaa2ec-b8e1-482e-af4c-2e371b2d3fc8 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68772024-12-20T21:36:55.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 872008b4-8dd0-402c-a2cc-d492318542b6 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68782024-12-20T21:36:55.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 872008b4-8dd0-402c-a2cc-d492318542b6 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68792024-12-20T21:36:55.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 872008b4-8dd0-402c-a2cc-d492318542b6 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68802024-12-20T21:36:56.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60480 req_id = ef6626c4-3bfb-44bf-af53-778d5fd746d6 roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
68812024-12-20T21:36:56.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60480 req_id = ef6626c4-3bfb-44bf-af53-778d5fd746d6 resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
68822024-12-20T21:36:56.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3409 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60480 req_id = ef6626c4-3bfb-44bf-af53-778d5fd746d6 response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?sort_by=id_ascending
68832024-12-20T21:36:56.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60480 req_id = 5e8d175e-1188-4e60-b599-e6c05cf046c4 roles = RoleSet { roles: {} } uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
68842024-12-20T21:36:56.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60480 req_id = 5e8d175e-1188-4e60-b599-e6c05cf046c4 resource = Database result = Ok(()) uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
68852024-12-20T21:36:56.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60480 req_id = 5e8d175e-1188-4e60-b599-e6c05cf046c4 response_code = 200 uri = /metrics/collectors/f413b9dc-12d9-42dc-9e49-cb25b63f7e80/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzdkYTBiNC02OTkzLTQyMGQtODY1ZC03MDlmMjkyMTFmZjMifX0%3D
68862024-12-20T21:36:56.407ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 555 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = a7d460a5-bf04-4629-b126-ff8d8251376c response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
68872024-12-20T21:36:56.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 84735ae3-02d7-48f4-bc78-ca63873fbf0d roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68882024-12-20T21:36:56.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 84735ae3-02d7-48f4-bc78-ca63873fbf0d resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68892024-12-20T21:36:56.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2623 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 84735ae3-02d7-48f4-bc78-ca63873fbf0d response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68902024-12-20T21:36:57.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 44c877f4-11f5-4723-8159-6920b8b0b46c roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68912024-12-20T21:36:57.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 44c877f4-11f5-4723-8159-6920b8b0b46c resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68922024-12-20T21:36:57.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 44c877f4-11f5-4723-8159-6920b8b0b46c response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68932024-12-20T21:36:58.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1cfee9a7-7ae7-4b83-b8a7-1a8aebb8ab60 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68942024-12-20T21:36:58.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1cfee9a7-7ae7-4b83-b8a7-1a8aebb8ab60 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68952024-12-20T21:36:58.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1cfee9a7-7ae7-4b83-b8a7-1a8aebb8ab60 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
68962024-12-20T21:36:59.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
68972024-12-20T21:36:59.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
68982024-12-20T21:36:59.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68992024-12-20T21:36:59.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69002024-12-20T21:36:59.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69012024-12-20T21:36:59.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69022024-12-20T21:36:59.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69032024-12-20T21:36:59.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69042024-12-20T21:36:59.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69052024-12-20T21:36:59.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69062024-12-20T21:36:59.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69072024-12-20T21:36:59.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69082024-12-20T21:36:59.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.941519ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69092024-12-20T21:36:59.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69102024-12-20T21:36:59.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69112024-12-20T21:36:59.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69122024-12-20T21:36:59.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
69132024-12-20T21:36:59.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69142024-12-20T21:36:59.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69152024-12-20T21:36:59.595ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
69162024-12-20T21:36:59.595ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.903551ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
69172024-12-20T21:36:59.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b666dec7-4a8d-430f-b8f8-cb5295119237 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69182024-12-20T21:36:59.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b666dec7-4a8d-430f-b8f8-cb5295119237 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69192024-12-20T21:36:59.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b666dec7-4a8d-430f-b8f8-cb5295119237 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69202024-12-20T21:37:00.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1e9b30ee-6b45-4e53-80c0-90e05eadc92a roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69212024-12-20T21:37:00.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1e9b30ee-6b45-4e53-80c0-90e05eadc92a resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69222024-12-20T21:37:00.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1e9b30ee-6b45-4e53-80c0-90e05eadc92a response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69232024-12-20T21:37:01.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 11578645-6ff3-47c6-9fa0-818472e8cc67 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69242024-12-20T21:37:01.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 11578645-6ff3-47c6-9fa0-818472e8cc67 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69252024-12-20T21:37:01.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 11578645-6ff3-47c6-9fa0-818472e8cc67 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69262024-12-20T21:37:02.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5d289987-4b3d-4de1-8c8d-21eed97f25f7 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69272024-12-20T21:37:02.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5d289987-4b3d-4de1-8c8d-21eed97f25f7 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69282024-12-20T21:37:02.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5d289987-4b3d-4de1-8c8d-21eed97f25f7 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69292024-12-20T21:37:03.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8cf72957-0b53-4774-9a34-834c12f59bd2 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69302024-12-20T21:37:03.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8cf72957-0b53-4774-9a34-834c12f59bd2 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69312024-12-20T21:37:03.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8cf72957-0b53-4774-9a34-834c12f59bd2 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69322024-12-20T21:37:04.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ce66d0c1-3c43-4648-a6bb-09105edec212 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69332024-12-20T21:37:04.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ce66d0c1-3c43-4648-a6bb-09105edec212 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69342024-12-20T21:37:04.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2803 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ce66d0c1-3c43-4648-a6bb-09105edec212 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69352024-12-20T21:37:05.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 86b6dbf6-4fad-4ba1-9de6-7fe8a3e7f5e9 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69362024-12-20T21:37:05.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 86b6dbf6-4fad-4ba1-9de6-7fe8a3e7f5e9 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69372024-12-20T21:37:05.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2658 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 86b6dbf6-4fad-4ba1-9de6-7fe8a3e7f5e9 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69382024-12-20T21:37:06.408ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 915 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = e22133e9-5d7d-4ff2-ac32-8c1592a5c333 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
69392024-12-20T21:37:07.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c11a4f47-469e-4e5f-a89a-32de46eb50b8 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69402024-12-20T21:37:07.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c11a4f47-469e-4e5f-a89a-32de46eb50b8 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69412024-12-20T21:37:07.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c11a4f47-469e-4e5f-a89a-32de46eb50b8 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69422024-12-20T21:37:08.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a6af3ed1-7b32-47c1-91c4-d3f4c54675e8 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69432024-12-20T21:37:08.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a6af3ed1-7b32-47c1-91c4-d3f4c54675e8 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69442024-12-20T21:37:08.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a6af3ed1-7b32-47c1-91c4-d3f4c54675e8 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69452024-12-20T21:37:09.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = af74a93f-97b7-48e2-8a19-19b2ac33838f roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69462024-12-20T21:37:09.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = af74a93f-97b7-48e2-8a19-19b2ac33838f resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69472024-12-20T21:37:09.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = af74a93f-97b7-48e2-8a19-19b2ac33838f response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69482024-12-20T21:37:09.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
69492024-12-20T21:37:09.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
69502024-12-20T21:37:09.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69512024-12-20T21:37:09.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69522024-12-20T21:37:09.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69532024-12-20T21:37:09.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69542024-12-20T21:37:09.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69552024-12-20T21:37:09.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69562024-12-20T21:37:09.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69572024-12-20T21:37:09.569ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.224985ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69582024-12-20T21:37:09.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69592024-12-20T21:37:09.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69602024-12-20T21:37:09.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69612024-12-20T21:37:09.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69622024-12-20T21:37:09.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69632024-12-20T21:37:09.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69642024-12-20T21:37:09.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
69652024-12-20T21:37:09.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69662024-12-20T21:37:09.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69672024-12-20T21:37:09.590ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
69682024-12-20T21:37:09.590ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.130584ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
69692024-12-20T21:37:10.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1d2899b9-5683-4537-a4cb-696cebe87a86 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69702024-12-20T21:37:10.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1d2899b9-5683-4537-a4cb-696cebe87a86 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69712024-12-20T21:37:10.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1d2899b9-5683-4537-a4cb-696cebe87a86 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69722024-12-20T21:37:11.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cbe0a4f7-aad3-4d69-8ad3-b9d970ed35d0 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69732024-12-20T21:37:11.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cbe0a4f7-aad3-4d69-8ad3-b9d970ed35d0 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69742024-12-20T21:37:11.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cbe0a4f7-aad3-4d69-8ad3-b9d970ed35d0 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69752024-12-20T21:37:12.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2a064269-62ff-4e9b-bf69-d63dd789ff9a roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69762024-12-20T21:37:12.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2a064269-62ff-4e9b-bf69-d63dd789ff9a resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69772024-12-20T21:37:12.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2a064269-62ff-4e9b-bf69-d63dd789ff9a response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69782024-12-20T21:37:13.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f8913199-aa65-40ba-9691-9d0980cda016 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69792024-12-20T21:37:13.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f8913199-aa65-40ba-9691-9d0980cda016 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69802024-12-20T21:37:13.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f8913199-aa65-40ba-9691-9d0980cda016 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69812024-12-20T21:37:14.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a17c3072-4a63-4c48-9f28-72c40591f89d roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69822024-12-20T21:37:14.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a17c3072-4a63-4c48-9f28-72c40591f89d resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69832024-12-20T21:37:14.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2935 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a17c3072-4a63-4c48-9f28-72c40591f89d response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69842024-12-20T21:37:15.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6d07da44-5aa8-4d31-8f10-c520b810607a roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69852024-12-20T21:37:15.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6d07da44-5aa8-4d31-8f10-c520b810607a resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69862024-12-20T21:37:15.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6d07da44-5aa8-4d31-8f10-c520b810607a response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69872024-12-20T21:37:16.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b3e92bf1-faf8-452f-b5db-d36f33ccd5c5 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69882024-12-20T21:37:16.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b3e92bf1-faf8-452f-b5db-d36f33ccd5c5 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69892024-12-20T21:37:16.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b3e92bf1-faf8-452f-b5db-d36f33ccd5c5 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69902024-12-20T21:37:16.407ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 626 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 125408de-e306-4676-be21-e24752f8cf64 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
69912024-12-20T21:37:17.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = c25b96fa-dae9-4450-8834-a285d75892b1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
69922024-12-20T21:37:17.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = c25b96fa-dae9-4450-8834-a285d75892b1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
69932024-12-20T21:37:17.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3409 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = c25b96fa-dae9-4450-8834-a285d75892b1 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
69942024-12-20T21:37:17.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 91e686e2-6df0-49b0-9fd2-4df129665c43 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69952024-12-20T21:37:17.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 91e686e2-6df0-49b0-9fd2-4df129665c43 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69962024-12-20T21:37:17.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 91e686e2-6df0-49b0-9fd2-4df129665c43 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69972024-12-20T21:37:18.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0e5fafc5-6568-40a5-b40b-812e1d227774 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69982024-12-20T21:37:18.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0e5fafc5-6568-40a5-b40b-812e1d227774 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
69992024-12-20T21:37:18.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0e5fafc5-6568-40a5-b40b-812e1d227774 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
70002024-12-20T21:37:19.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1e23374c-1837-410a-adcd-d86d7a6e687b roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
70012024-12-20T21:37:19.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1e23374c-1837-410a-adcd-d86d7a6e687b resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
70022024-12-20T21:37:19.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 1e23374c-1837-410a-adcd-d86d7a6e687b response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
70032024-12-20T21:37:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
70042024-12-20T21:37:19.540ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 16 reason = Timeout
70052024-12-20T21:37:19.540ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
70062024-12-20T21:37:19.540ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
70072024-12-20T21:37:19.540ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
70082024-12-20T21:37:19.540ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
70092024-12-20T21:37:19.540ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
70102024-12-20T21:37:19.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70112024-12-20T21:37:19.540ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
70122024-12-20T21:37:19.540ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70132024-12-20T21:37:19.540ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
70142024-12-20T21:37:19.540ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70152024-12-20T21:37:19.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
70162024-12-20T21:37:19.540ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
70172024-12-20T21:37:19.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70182024-12-20T21:37:19.540ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
70192024-12-20T21:37:19.540ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
70202024-12-20T21:37:19.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 31 reason = Timeout
70212024-12-20T21:37:19.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
70222024-12-20T21:37:19.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70232024-12-20T21:37:19.540ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 16 reason = Timeout
70242024-12-20T21:37:19.540ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
70252024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 31 reason = Timeout
70262024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
70272024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 31 reason = Timeout
70282024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70292024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 16 reason = Timeout
70302024-12-20T21:37:19.541ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 21:27:19.540830308 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
70312024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
70322024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 16 reason = Timeout
70332024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
70342024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 18 reason = Timeout
70352024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
70362024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 31 reason = Timeout
70372024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70382024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70392024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
70402024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70412024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 31 reason = Timeout
70422024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70432024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 31 reason = Timeout
70442024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70452024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 31 reason = Timeout
70462024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70472024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
70482024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 17 reason = Timeout
70492024-12-20T21:37:19.541ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9112287e-7109-46ca-aa8a-610048d83c82
70502024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.95\u{b5}s iteration = 17 status = {"enabled":false,"target_id":"9112287e-7109-46ca-aa8a-610048d83c82"}
70512024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
70522024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 91 reason = Timeout
70532024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
70542024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70552024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70562024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 16 reason = Timeout
70572024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 91 reason = Timeout
70582024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
70592024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 7 reason = Timeout
70602024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 31 reason = Timeout
70612024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70622024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 31 reason = Timeout
70632024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70642024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 31 reason = Timeout
70652024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70662024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70672024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 31 reason = Timeout
70682024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 18 reason = Timeout
70692024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
70702024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
70712024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70722024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70732024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
70742024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
70752024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70762024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70772024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
70782024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70792024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70802024-12-20T21:37:19.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
70812024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70822024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
70832024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70842024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70852024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70862024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70872024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70882024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70892024-12-20T21:37:19.542ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("065cea45-0eca-4287-90a0-2c3c20ec32f8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b24cb173-c3a3-4237-abe6-0e7953a415e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b24cb173-c3a3-4237-abe6-0e7953a415e5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1738, tv_nsec: 819777245 } })
70902024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70912024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70922024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70932024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70942024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
70952024-12-20T21:37:19.542ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4565f09e-ee63-469d-bb6e-3ccd4abd01fe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("73abfaca-4f35-4f97-9980-1890d6dba8fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f3f6b067-d10e-44b3-9f21-f8e5a96a2b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f3f6b067-d10e-44b3-9f21-f8e5a96a2b37.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1738, tv_nsec: 819807966 } })
70962024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70972024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
70982024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70992024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71002024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71012024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71022024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71032024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
71042024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.473973ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
71052024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71062024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71072024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
71082024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.973394ms iteration = 16 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
71092024-12-20T21:37:19.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71102024-12-20T21:37:19.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71112024-12-20T21:37:19.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71122024-12-20T21:37:19.543ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71132024-12-20T21:37:19.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.611304ms iteration = 31 status = {"errors":[],"finish_invoked_ok":[]}
71142024-12-20T21:37:19.545ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.432869ms iteration = 31 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
71152024-12-20T21:37:19.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
71162024-12-20T21:37:19.545ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
71172024-12-20T21:37:19.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
71182024-12-20T21:37:19.546ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 21:27:19.540830308 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
71192024-12-20T21:37:19.546ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.678008ms iteration = 16 status = {"expiration":"2024-12-20T21:27:19.540830308Z","pruned":[]}
71202024-12-20T21:37:19.546ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71212024-12-20T21:37:19.547ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71222024-12-20T21:37:19.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71232024-12-20T21:37:19.548ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71242024-12-20T21:37:19.548ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71252024-12-20T21:37:19.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71262024-12-20T21:37:19.551ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71272024-12-20T21:37:19.552ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1738, tv_nsec: 829779769 } })
71282024-12-20T21:37:19.552ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
71292024-12-20T21:37:19.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
71302024-12-20T21:37:19.553ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71312024-12-20T21:37:19.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71322024-12-20T21:37:19.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71332024-12-20T21:37:19.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71342024-12-20T21:37:19.556ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71352024-12-20T21:37:19.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
71362024-12-20T21:37:19.558ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71372024-12-20T21:37:19.558ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1738, tv_nsec: 836050050 } })
71382024-12-20T21:37:19.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71392024-12-20T21:37:19.558ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.344769ms iteration = 16 status = {"errors":[],"found_port_ok":[]}
71402024-12-20T21:37:19.558ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
71412024-12-20T21:37:19.565ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71422024-12-20T21:37:19.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
71432024-12-20T21:37:19.567ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71442024-12-20T21:37:19.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71452024-12-20T21:37:19.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71462024-12-20T21:37:19.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71472024-12-20T21:37:19.590ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71482024-12-20T21:37:19.590ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
71492024-12-20T21:37:19.590ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71502024-12-20T21:37:19.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71512024-12-20T21:37:19.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71522024-12-20T21:37:19.593ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71532024-12-20T21:37:19.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71542024-12-20T21:37:19.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
71552024-12-20T21:37:19.594ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71562024-12-20T21:37:19.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71572024-12-20T21:37:19.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71582024-12-20T21:37:19.596ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
71592024-12-20T21:37:19.596ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
71602024-12-20T21:37:19.596ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 56.010766ms iteration = 16 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
71612024-12-20T21:37:19.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71622024-12-20T21:37:19.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71632024-12-20T21:37:19.599ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71642024-12-20T21:37:19.599ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71652024-12-20T21:37:19.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71662024-12-20T21:37:19.600ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71672024-12-20T21:37:19.601ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71682024-12-20T21:37:19.602ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 61.243043ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71692024-12-20T21:37:19.602ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71702024-12-20T21:37:19.603ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71712024-12-20T21:37:19.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
71722024-12-20T21:37:19.604ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71732024-12-20T21:37:19.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71742024-12-20T21:37:19.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71752024-12-20T21:37:19.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71762024-12-20T21:37:19.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71772024-12-20T21:37:19.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71782024-12-20T21:37:19.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
71792024-12-20T21:37:19.606ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71802024-12-20T21:37:19.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71812024-12-20T21:37:19.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71822024-12-20T21:37:19.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.338257ms iteration = 31 status = {"errors":[],"garbage_collect_requested":[]}
71832024-12-20T21:37:19.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
71842024-12-20T21:37:19.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71852024-12-20T21:37:19.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71862024-12-20T21:37:19.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71872024-12-20T21:37:19.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71882024-12-20T21:37:19.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71892024-12-20T21:37:19.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71902024-12-20T21:37:19.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71912024-12-20T21:37:19.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71922024-12-20T21:37:19.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71932024-12-20T21:37:19.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71942024-12-20T21:37:19.610ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71952024-12-20T21:37:19.611ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71962024-12-20T21:37:19.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71972024-12-20T21:37:19.611ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71982024-12-20T21:37:19.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71992024-12-20T21:37:19.612ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1738, tv_nsec: 890551062 } })
72002024-12-20T21:37:19.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72012024-12-20T21:37:19.613ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72022024-12-20T21:37:19.613ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
72032024-12-20T21:37:19.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72042024-12-20T21:37:19.613ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72052024-12-20T21:37:19.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72062024-12-20T21:37:19.614ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72072024-12-20T21:37:19.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72082024-12-20T21:37:19.626ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
72092024-12-20T21:37:19.626ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
72102024-12-20T21:37:19.626ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 85.439996ms iteration = 16 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
72112024-12-20T21:37:19.626ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
72122024-12-20T21:37:19.626ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
72132024-12-20T21:37:19.626ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
72142024-12-20T21:37:19.626ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72152024-12-20T21:37:19.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72162024-12-20T21:37:19.639ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
72172024-12-20T21:37:19.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
72182024-12-20T21:37:19.642ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
72192024-12-20T21:37:19.642ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 101.041026ms iteration = 31 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
72202024-12-20T21:37:19.645ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
72212024-12-20T21:37:19.645ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
72222024-12-20T21:37:19.645ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
72232024-12-20T21:37:19.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72242024-12-20T21:37:19.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72252024-12-20T21:37:19.647ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72262024-12-20T21:37:19.647ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
72272024-12-20T21:37:19.647ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72282024-12-20T21:37:19.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72292024-12-20T21:37:19.672ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
72302024-12-20T21:37:19.673ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72312024-12-20T21:37:19.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72322024-12-20T21:37:19.732ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
72332024-12-20T21:37:19.732ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72342024-12-20T21:37:19.733ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "784ca9e9-7d86-49d6-9cde-8250d9b03a79", "content-length": "26", "date": "Fri, 20 Dec 2024 21:37:18 GMT"} })
72352024-12-20T21:37:19.733ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72362024-12-20T21:37:19.734ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72372024-12-20T21:37:19.768ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac zone_address = fd00:1122:3344:101::2
72382024-12-20T21:37:19.768ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72392024-12-20T21:37:19.769ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "943a8af2-2e33-4df5-9e9c-bc759dabd953", "content-length": "26", "date": "Fri, 20 Dec 2024 21:37:18 GMT"} })
72402024-12-20T21:37:19.769ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72412024-12-20T21:37:19.770ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
72422024-12-20T21:37:19.785ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
72432024-12-20T21:37:19.808ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
72442024-12-20T21:37:19.808ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72452024-12-20T21:37:19.809ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fe0e917-7794-48e6-a70d-ce88612084d3", "content-length": "372", "date": "Fri, 20 Dec 2024 21:37:19 GMT"} })
72462024-12-20T21:37:19.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72472024-12-20T21:37:19.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72482024-12-20T21:37:19.811ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72492024-12-20T21:37:19.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72502024-12-20T21:37:19.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72512024-12-20T21:37:19.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72522024-12-20T21:37:19.812ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72532024-12-20T21:37:19.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72542024-12-20T21:37:19.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72552024-12-20T21:37:19.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72562024-12-20T21:37:19.813ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 272.316207ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
72572024-12-20T21:37:19.814ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 273.524073ms iteration = 7 status = {"nsuccess":5}
72582024-12-20T21:37:19.815ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72592024-12-20T21:37:19.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72602024-12-20T21:37:19.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72612024-12-20T21:37:19.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72622024-12-20T21:37:19.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72632024-12-20T21:37:19.821ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72642024-12-20T21:37:19.824ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
72652024-12-20T21:37:19.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
72662024-12-20T21:37:19.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72672024-12-20T21:37:19.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72682024-12-20T21:37:19.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72692024-12-20T21:37:19.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72702024-12-20T21:37:19.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72712024-12-20T21:37:19.843ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72722024-12-20T21:37:19.843ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
72732024-12-20T21:37:19.843ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 302.431671ms iteration = 91 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
72742024-12-20T21:37:19.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72752024-12-20T21:37:19.845ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72762024-12-20T21:37:19.845ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72772024-12-20T21:37:19.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72782024-12-20T21:37:19.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72792024-12-20T21:37:19.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72802024-12-20T21:37:19.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72812024-12-20T21:37:19.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72822024-12-20T21:37:19.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72832024-12-20T21:37:19.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72842024-12-20T21:37:19.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72852024-12-20T21:37:19.850ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72862024-12-20T21:37:19.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 310.174425ms iteration = 91 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72872024-12-20T21:37:19.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
72882024-12-20T21:37:19.854ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72892024-12-20T21:37:19.854ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72902024-12-20T21:37:19.854ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
72912024-12-20T21:37:19.854ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 314.017171ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
72922024-12-20T21:37:19.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72932024-12-20T21:37:19.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72942024-12-20T21:37:19.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72952024-12-20T21:37:19.861ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
72962024-12-20T21:37:19.861ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4aec9cd8-ad86-40dc-bdd7-2394e3237b38 dns_zone_name = oxide.test found_so_far = 0 version = 2
72972024-12-20T21:37:19.861ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72982024-12-20T21:37:19.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72992024-12-20T21:37:19.879ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
73002024-12-20T21:37:19.880ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
73012024-12-20T21:37:19.880ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b7fc8524-a011-4b78-a2bf-642581e74144", "date": "Fri, 20 Dec 2024 21:37:19 GMT"} })
73022024-12-20T21:37:19.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73032024-12-20T21:37:19.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73042024-12-20T21:37:19.881ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
73052024-12-20T21:37:19.881ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73062024-12-20T21:37:19.882ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "44c80ea0-5089-4d7d-a3b3-392ad8dbaa2b", "content-length": "26", "date": "Fri, 20 Dec 2024 21:37:19 GMT"} })
73072024-12-20T21:37:19.882ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73082024-12-20T21:37:19.884ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73092024-12-20T21:37:19.887ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73102024-12-20T21:37:19.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73112024-12-20T21:37:19.891ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73122024-12-20T21:37:19.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73132024-12-20T21:37:19.893ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73142024-12-20T21:37:19.896ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 355.525801ms iteration = 31 status = {}
73152024-12-20T21:37:19.896ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
73162024-12-20T21:37:19.896ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73172024-12-20T21:37:19.897ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c9645db8-6394-4e25-bcef-96ecbca90f22", "date": "Fri, 20 Dec 2024 21:37:19 GMT"} })
73182024-12-20T21:37:19.898ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 358.186671ms iteration = 32 status = {}
73192024-12-20T21:37:19.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
73202024-12-20T21:37:19.899ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73212024-12-20T21:37:19.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73222024-12-20T21:37:19.901ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73232024-12-20T21:37:19.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73242024-12-20T21:37:19.906ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73252024-12-20T21:37:19.908ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
73262024-12-20T21:37:19.908ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c58feff7-51f2-445e-83fd-a0c3a102f4ed dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
73272024-12-20T21:37:19.908ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73282024-12-20T21:37:19.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73292024-12-20T21:37:19.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c74ff24-982c-40fd-86fd-ef04898c5922, lookup_type: ById(8c74ff24-982c-40fd-86fd-ef04898c5922) } result = Ok(())
73302024-12-20T21:37:19.910ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73312024-12-20T21:37:19.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73322024-12-20T21:37:19.912ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73332024-12-20T21:37:19.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 371.95938ms iteration = 31 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
73342024-12-20T21:37:19.913ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 372.484611ms iteration = 31 status = 0
73352024-12-20T21:37:19.914ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73362024-12-20T21:37:19.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
73372024-12-20T21:37:19.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73382024-12-20T21:37:19.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73392024-12-20T21:37:19.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
73402024-12-20T21:37:19.919ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73412024-12-20T21:37:19.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73422024-12-20T21:37:19.927ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4aec9cd8-ad86-40dc-bdd7-2394e3237b38 dns_zone_name = oxide.test found_so_far = 1 version = 2
73432024-12-20T21:37:19.927ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
73442024-12-20T21:37:19.927ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 21:23:05.526309 UTC dns_group = external generation = 2
73452024-12-20T21:37:19.927ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 386.812963ms iteration = 16 status = {"generation":2}
73462024-12-20T21:37:19.931ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c58feff7-51f2-445e-83fd-a0c3a102f4ed dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
73472024-12-20T21:37:19.931ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
73482024-12-20T21:37:19.931ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 21:23:04.517297 UTC dns_group = internal generation = 1
73492024-12-20T21:37:19.931ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 390.581508ms iteration = 16 status = {"generation":1}
73502024-12-20T21:37:19.943ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
73512024-12-20T21:37:19.944ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 403.109788ms iteration = 16 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
73522024-12-20T21:37:19.955ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
73532024-12-20T21:37:19.956ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f4f6f267-dc59-493c-8545-fb98fc2f68bc", "date": "Fri, 20 Dec 2024 21:37:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
73542024-12-20T21:37:19.956ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
73552024-12-20T21:37:19.958ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "61ede4dc-7f89-4525-b7e6-f137b4605fc0", "date": "Fri, 20 Dec 2024 21:37:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
73562024-12-20T21:37:19.958ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
73572024-12-20T21:37:19.960ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7d674ecb-dfe1-46fa-aadb-69500b82f08a", "date": "Fri, 20 Dec 2024 21:37:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
73582024-12-20T21:37:19.960ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
73592024-12-20T21:37:19.962ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73602024-12-20T21:37:19.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73612024-12-20T21:37:19.963ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
73622024-12-20T21:37:19.963ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 422.8216ms iteration = 18 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
73632024-12-20T21:37:19.964ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73642024-12-20T21:37:19.964ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73652024-12-20T21:37:19.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73662024-12-20T21:37:19.965ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73672024-12-20T21:37:19.966ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73682024-12-20T21:37:19.966ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73692024-12-20T21:37:19.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73702024-12-20T21:37:19.967ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
73712024-12-20T21:37:19.967ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73722024-12-20T21:37:19.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73732024-12-20T21:37:19.969ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73742024-12-20T21:37:19.971ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73752024-12-20T21:37:19.971ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73762024-12-20T21:37:19.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73772024-12-20T21:37:19.977ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 436.907616ms iteration = 34 status = {"physical_disks_added":0}
73782024-12-20T21:37:19.991ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
73792024-12-20T21:37:19.991ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0a5fa06d-de9e-477a-8323-be1ba50e93be", "date": "Fri, 20 Dec 2024 21:37:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73802024-12-20T21:37:19.991ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73812024-12-20T21:37:19.993ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8be6c5d0-ab41-4b52-89e4-94a64f315745", "date": "Fri, 20 Dec 2024 21:37:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73822024-12-20T21:37:19.993ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73832024-12-20T21:37:19.995ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73842024-12-20T21:37:19.995ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 453.850726ms iteration = 18 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
73852024-12-20T21:37:20.002ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
73862024-12-20T21:37:20.002ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "22ca98d5-0144-4d53-a1c8-ab0c94bbe25c", "content-length": "2", "date": "Fri, 20 Dec 2024 21:37:19 GMT"} })
73872024-12-20T21:37:20.004ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73882024-12-20T21:37:20.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73892024-12-20T21:37:20.007ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 466.478599ms iteration = 31 status = null
73902024-12-20T21:37:20.011ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73912024-12-20T21:37:20.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73922024-12-20T21:37:20.014ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73932024-12-20T21:37:20.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
73942024-12-20T21:37:20.018ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73952024-12-20T21:37:20.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73962024-12-20T21:37:20.020ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T21:22:10.640928Z, time_modified: 2024-12-20T21:22:10.640928Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, db_silo: Silo { identity: SiloIdentity { id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T21:23:05.471312Z, time_modified: 2024-12-20T21:23:05.471312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, db_silo: Silo { identity: SiloIdentity { id: 66e8bce1-b95a-4433-886f-e35fda6d9a14, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T21:23:05.471312Z, time_modified: 2024-12-20T21:23:05.471312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b" }] }) }
73972024-12-20T21:37:20.020ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 479.923621ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"66e8bce1-b95a-4433-886f-e35fda6d9a14","tls_certs":["4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b"]}},"default_endpoint":{"silo_id":"66e8bce1-b95a-4433-886f-e35fda6d9a14","tls_certs":["4ab65441d8a48b9648766ba8b044c2816473c9f687539713d82bc36d1ed6339b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
73982024-12-20T21:37:20.021ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73992024-12-20T21:37:20.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74002024-12-20T21:37:20.026ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74012024-12-20T21:37:20.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74022024-12-20T21:37:20.030ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74032024-12-20T21:37:20.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74042024-12-20T21:37:20.033ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74052024-12-20T21:37:20.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74062024-12-20T21:37:20.034ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74072024-12-20T21:37:20.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74082024-12-20T21:37:20.036ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74092024-12-20T21:37:20.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74102024-12-20T21:37:20.038ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74112024-12-20T21:37:20.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
74122024-12-20T21:37:20.042ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74132024-12-20T21:37:20.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74142024-12-20T21:37:20.045ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74152024-12-20T21:37:20.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74162024-12-20T21:37:20.048ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74172024-12-20T21:37:20.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74182024-12-20T21:37:20.050ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74192024-12-20T21:37:20.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74202024-12-20T21:37:20.051ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74212024-12-20T21:37:20.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74222024-12-20T21:37:20.053ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74232024-12-20T21:37:20.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74242024-12-20T21:37:20.081ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
74252024-12-20T21:37:20.082ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a0c44f9-f070-4c1a-ba40-d4d091525448", "content-length": "691", "date": "Fri, 20 Dec 2024 21:37:19 GMT"} })
74262024-12-20T21:37:20.082ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
74272024-12-20T21:37:20.082ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
74282024-12-20T21:37:20.082ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
74292024-12-20T21:37:20.082ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 541.842209ms iteration = 32 status = {}
74302024-12-20T21:37:20.083ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74312024-12-20T21:37:20.083ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 583388f4-92af-4a10-817c-62f2e9571310, rack_id: a7e68df9-95f5-4fda-aae0-2f46483e29ac, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bacaa666-9eda-4bc8-9ccd-35df228fd476) } rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
74322024-12-20T21:37:20.083ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74332024-12-20T21:37:20.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74342024-12-20T21:37:20.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74352024-12-20T21:37:20.085ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74362024-12-20T21:37:20.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74372024-12-20T21:37:20.086ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74382024-12-20T21:37:20.090ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
74392024-12-20T21:37:20.090ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74402024-12-20T21:37:20.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74412024-12-20T21:37:20.092ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74422024-12-20T21:37:20.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74432024-12-20T21:37:20.093ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
74442024-12-20T21:37:20.093ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74452024-12-20T21:37:20.094ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5cad8ee3-bb83-4037-aa61-0408216c004d", "content-length": "134", "date": "Fri, 20 Dec 2024 21:37:19 GMT"} })
74462024-12-20T21:37:20.094ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
74472024-12-20T21:37:20.094ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bacaa666-9eda-4bc8-9ccd-35df228fd476
74482024-12-20T21:37:20.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74492024-12-20T21:37:20.094ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
74502024-12-20T21:37:20.094ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
74512024-12-20T21:37:20.094ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74522024-12-20T21:37:20.094ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74532024-12-20T21:37:20.094ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74542024-12-20T21:37:20.094ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74552024-12-20T21:37:20.094ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74562024-12-20T21:37:20.094ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74572024-12-20T21:37:20.094ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
74582024-12-20T21:37:20.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74592024-12-20T21:37:20.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74602024-12-20T21:37:20.095ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74612024-12-20T21:37:20.097ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
74622024-12-20T21:37:20.097ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b99d1966-a0c1-4214-a6a8-b1bbacb4e991", "content-length": "2", "date": "Fri, 20 Dec 2024 21:37:19 GMT"} })
74632024-12-20T21:37:20.097ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
74642024-12-20T21:37:20.097ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b3b61c6-d1d4-4bc3-b63a-ea6151fbbe59", "content-length": "52", "date": "Fri, 20 Dec 2024 21:37:19 GMT"} })
74652024-12-20T21:37:20.097ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
74662024-12-20T21:37:20.097ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
74672024-12-20T21:37:20.099ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
74682024-12-20T21:37:20.099ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74692024-12-20T21:37:20.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74702024-12-20T21:37:20.104ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74712024-12-20T21:37:20.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74722024-12-20T21:37:20.106ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74732024-12-20T21:37:20.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74742024-12-20T21:37:20.108ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74752024-12-20T21:37:20.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74762024-12-20T21:37:20.110ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74772024-12-20T21:37:20.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74782024-12-20T21:37:20.112ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74792024-12-20T21:37:20.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74802024-12-20T21:37:20.114ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74812024-12-20T21:37:20.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74822024-12-20T21:37:20.116ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74832024-12-20T21:37:20.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74842024-12-20T21:37:20.117ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74852024-12-20T21:37:20.121ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
74862024-12-20T21:37:20.121ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74872024-12-20T21:37:20.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74882024-12-20T21:37:20.122ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74892024-12-20T21:37:20.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74902024-12-20T21:37:20.124ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74912024-12-20T21:37:20.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74922024-12-20T21:37:20.125ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74932024-12-20T21:37:20.129ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
74942024-12-20T21:37:20.129ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74952024-12-20T21:37:20.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74962024-12-20T21:37:20.136ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 2d75a81e-7e26-4d89-8f45-4a8a30dcc43e, kind: Service { id: 065cea45-0eca-4287-90a0-2c3c20ec32f8 }, name: Name("external-dns-065cea45-0eca-4287-90a0-2c3c20ec32f8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 64])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fe340e0e-7e73-4e4d-9e13-6fa58166803a, kind: Service { id: b24cb173-c3a3-4237-abe6-0e7953a415e5 }, name: Name("external-dns-b24cb173-c3a3-4237-abe6-0e7953a415e5"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 2])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 3cdfaf5a-6ab2-4340-badd-90537467f215, kind: Service { id: 1ab9e34a-bb03-4bfb-a926-0dc397c4d4ad }, name: Name("nexus-1ab9e34a-bb03-4bfb-a926-0dc397c4d4ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 196])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ca6d922-6012-48ca-ab83-904f1e9b7f23, kind: Service { id: 0a5aaad3-b9af-4668-92b2-6758e325a2ed }, name: Name("nexus-0a5aaad3-b9af-4668-92b2-6758e325a2ed"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 161])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c6bf8c6b-87e0-4464-b6f8-ef452a4011b6, kind: Service { id: 12bea37a-3ccb-4c9f-8c92-9d6095867a0f }, name: Name("nexus-12bea37a-3ccb-4c9f-8c92-9d6095867a0f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
74972024-12-20T21:37:20.136ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74982024-12-20T21:37:20.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74992024-12-20T21:37:20.138ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75002024-12-20T21:37:20.139ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
75012024-12-20T21:37:20.139ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75022024-12-20T21:37:20.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75032024-12-20T21:37:20.141ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
75042024-12-20T21:37:20.141ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2d75a81e-7e26-4d89-8f45-4a8a30dcc43e, kind: Service { id: 065cea45-0eca-4287-90a0-2c3c20ec32f8 }, name: Name("external-dns-065cea45-0eca-4287-90a0-2c3c20ec32f8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 64])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fe340e0e-7e73-4e4d-9e13-6fa58166803a, kind: Service { id: b24cb173-c3a3-4237-abe6-0e7953a415e5 }, name: Name("external-dns-b24cb173-c3a3-4237-abe6-0e7953a415e5"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 2])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 3cdfaf5a-6ab2-4340-badd-90537467f215, kind: Service { id: 1ab9e34a-bb03-4bfb-a926-0dc397c4d4ad }, name: Name("nexus-1ab9e34a-bb03-4bfb-a926-0dc397c4d4ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 196])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ca6d922-6012-48ca-ab83-904f1e9b7f23, kind: Service { id: 0a5aaad3-b9af-4668-92b2-6758e325a2ed }, name: Name("nexus-0a5aaad3-b9af-4668-92b2-6758e325a2ed"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 161])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c6bf8c6b-87e0-4464-b6f8-ef452a4011b6, kind: Service { id: 12bea37a-3ccb-4c9f-8c92-9d6095867a0f }, name: Name("nexus-12bea37a-3ccb-4c9f-8c92-9d6095867a0f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
75052024-12-20T21:37:20.141ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
75062024-12-20T21:37:20.198ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "83a12b0d-1a15-4bf6-8008-94d811954a96", "date": "Fri, 20 Dec 2024 21:37:19 GMT"} })
75072024-12-20T21:37:20.198ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch = Switch0
75082024-12-20T21:37:20.198ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
75092024-12-20T21:37:20.199ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ceca000-25e7-41b9-bccc-26c217c37c9e", "content-length": "682", "date": "Fri, 20 Dec 2024 21:37:19 GMT"} })
75102024-12-20T21:37:20.199ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75112024-12-20T21:37:20.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75122024-12-20T21:37:20.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75132024-12-20T21:37:20.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75142024-12-20T21:37:20.209ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75152024-12-20T21:37:20.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75162024-12-20T21:37:20.211ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75172024-12-20T21:37:20.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75182024-12-20T21:37:20.219ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 678.435522ms iteration = 31 status = {}
75192024-12-20T21:37:20.281ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 8c74ff24-982c-40fd-86fd-ef04898c5922, time_created: 2024-12-20T21:23:00.593272Z, time_modified: 2024-12-20T21:23:00.593272Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: a7e68df9-95f5-4fda-aae0-2f46483e29ac, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
75202024-12-20T21:37:20.281ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
75212024-12-20T21:37:20.281ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75222024-12-20T21:37:20.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75232024-12-20T21:37:20.284ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75242024-12-20T21:37:20.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75252024-12-20T21:37:20.287ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75262024-12-20T21:37:20.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 8c74ff24-982c-40fd-86fd-ef04898c5922, lookup_type: ById(8c74ff24-982c-40fd-86fd-ef04898c5922) } result = Ok(())
75272024-12-20T21:37:20.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a4101baa-d447-4ac7-b766-d2b4006178a7 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75282024-12-20T21:37:20.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a4101baa-d447-4ac7-b766-d2b4006178a7 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75292024-12-20T21:37:20.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2861 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a4101baa-d447-4ac7-b766-d2b4006178a7 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75302024-12-20T21:37:20.336ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
75312024-12-20T21:37:20.337ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "241ba5a3-586d-4b30-822c-d7c0ad64c009", "date": "Fri, 20 Dec 2024 21:37:20 GMT"} })
75322024-12-20T21:37:20.338ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
75332024-12-20T21:37:20.338ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 797.995553ms
75342024-12-20T21:37:20.338ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 798.009914ms iteration = 4 status = {}
75352024-12-20T21:37:21.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cd022803-2982-4963-9563-69f1c9fda30e roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75362024-12-20T21:37:21.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cd022803-2982-4963-9563-69f1c9fda30e resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75372024-12-20T21:37:21.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2649 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = cd022803-2982-4963-9563-69f1c9fda30e response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75382024-12-20T21:37:22.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 12b26a40-c5d0-475e-a9a1-9c1d91e114ed roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75392024-12-20T21:37:22.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 12b26a40-c5d0-475e-a9a1-9c1d91e114ed resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75402024-12-20T21:37:22.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 12b26a40-c5d0-475e-a9a1-9c1d91e114ed response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75412024-12-20T21:37:23.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0003a877-da1c-4499-9395-aec0f8ddab1a roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75422024-12-20T21:37:23.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0003a877-da1c-4499-9395-aec0f8ddab1a resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75432024-12-20T21:37:23.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2770 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 0003a877-da1c-4499-9395-aec0f8ddab1a response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75442024-12-20T21:37:24.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8249731a-33d5-48b6-b126-1f85b21381cc roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75452024-12-20T21:37:24.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8249731a-33d5-48b6-b126-1f85b21381cc resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75462024-12-20T21:37:24.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2825 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 8249731a-33d5-48b6-b126-1f85b21381cc response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75472024-12-20T21:37:25.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 439003c5-7e78-4f67-91b5-f577d8d158b7 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75482024-12-20T21:37:25.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 439003c5-7e78-4f67-91b5-f577d8d158b7 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75492024-12-20T21:37:25.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2824 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 439003c5-7e78-4f67-91b5-f577d8d158b7 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75502024-12-20T21:37:26.408ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 992 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 6cb94b29-9506-4041-bce7-32425ce3c0f3 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
75512024-12-20T21:37:26.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 02ea7c59-4c4a-48d1-90c3-b35f6f9446ab roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75522024-12-20T21:37:26.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 02ea7c59-4c4a-48d1-90c3-b35f6f9446ab resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75532024-12-20T21:37:26.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 02ea7c59-4c4a-48d1-90c3-b35f6f9446ab response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75542024-12-20T21:37:27.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9060a999-a2a6-4b68-afbf-e8c9c3cff363 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75552024-12-20T21:37:27.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9060a999-a2a6-4b68-afbf-e8c9c3cff363 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75562024-12-20T21:37:27.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9060a999-a2a6-4b68-afbf-e8c9c3cff363 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75572024-12-20T21:37:28.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9ae623ca-3429-4e2b-b49a-44db18d7fb9d roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75582024-12-20T21:37:28.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9ae623ca-3429-4e2b-b49a-44db18d7fb9d resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75592024-12-20T21:37:28.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9ae623ca-3429-4e2b-b49a-44db18d7fb9d response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75602024-12-20T21:37:29.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e86f8a09-0dd6-4584-b837-8621d9816e56 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75612024-12-20T21:37:29.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e86f8a09-0dd6-4584-b837-8621d9816e56 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75622024-12-20T21:37:29.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = e86f8a09-0dd6-4584-b837-8621d9816e56 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75632024-12-20T21:37:29.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 92 reason = Timeout
75642024-12-20T21:37:29.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 92 reason = Timeout
75652024-12-20T21:37:29.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75662024-12-20T21:37:29.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75672024-12-20T21:37:29.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75682024-12-20T21:37:29.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75692024-12-20T21:37:29.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75702024-12-20T21:37:29.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75712024-12-20T21:37:29.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75722024-12-20T21:37:29.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75732024-12-20T21:37:29.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75742024-12-20T21:37:29.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75752024-12-20T21:37:29.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75762024-12-20T21:37:29.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
75772024-12-20T21:37:29.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75782024-12-20T21:37:29.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75792024-12-20T21:37:29.570ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
75802024-12-20T21:37:29.570ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.617513ms iteration = 92 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
75812024-12-20T21:37:29.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75822024-12-20T21:37:29.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75832024-12-20T21:37:29.608ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.447012ms iteration = 92 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75842024-12-20T21:37:30.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 36d328ed-3f2d-499c-9747-c4e0b0e63e9e roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75852024-12-20T21:37:30.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 36d328ed-3f2d-499c-9747-c4e0b0e63e9e resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75862024-12-20T21:37:30.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 36d328ed-3f2d-499c-9747-c4e0b0e63e9e response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75872024-12-20T21:37:31.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 21b1047f-20d2-47bb-8c6e-0f057524de54 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75882024-12-20T21:37:31.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 21b1047f-20d2-47bb-8c6e-0f057524de54 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75892024-12-20T21:37:31.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 21b1047f-20d2-47bb-8c6e-0f057524de54 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75902024-12-20T21:37:32.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f0f76849-e9c8-4e6f-8eb4-a4f2e3a9a81e roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75912024-12-20T21:37:32.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f0f76849-e9c8-4e6f-8eb4-a4f2e3a9a81e resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75922024-12-20T21:37:32.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2532 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = f0f76849-e9c8-4e6f-8eb4-a4f2e3a9a81e response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75932024-12-20T21:37:33.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9ec280ac-bfe5-45b0-8352-1a96ce10d126 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75942024-12-20T21:37:33.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9ec280ac-bfe5-45b0-8352-1a96ce10d126 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75952024-12-20T21:37:33.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2720 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9ec280ac-bfe5-45b0-8352-1a96ce10d126 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75962024-12-20T21:37:34.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = acc108e5-58cf-4dd4-821e-3adb1e81accf roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75972024-12-20T21:37:34.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = acc108e5-58cf-4dd4-821e-3adb1e81accf resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75982024-12-20T21:37:34.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = acc108e5-58cf-4dd4-821e-3adb1e81accf response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
75992024-12-20T21:37:35.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a57fa7a5-f67d-4d78-813d-3f597a85f37c roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76002024-12-20T21:37:35.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a57fa7a5-f67d-4d78-813d-3f597a85f37c resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76012024-12-20T21:37:35.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a57fa7a5-f67d-4d78-813d-3f597a85f37c response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76022024-12-20T21:37:36.408ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 681 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 9fd16ed6-e8a8-4f9e-978d-6a49bf4a598c response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
76032024-12-20T21:37:36.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5d0ec82b-8c86-4a8b-a224-0c81cbd6c016 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76042024-12-20T21:37:36.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5d0ec82b-8c86-4a8b-a224-0c81cbd6c016 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76052024-12-20T21:37:36.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5d0ec82b-8c86-4a8b-a224-0c81cbd6c016 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76062024-12-20T21:37:37.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d00533d6-fdfd-46e0-b268-f0b71547bfae roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76072024-12-20T21:37:37.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d00533d6-fdfd-46e0-b268-f0b71547bfae resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76082024-12-20T21:37:37.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = d00533d6-fdfd-46e0-b268-f0b71547bfae response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76092024-12-20T21:37:38.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b84216cc-8205-4103-9c8a-e86cf8dba69b roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76102024-12-20T21:37:38.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b84216cc-8205-4103-9c8a-e86cf8dba69b resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76112024-12-20T21:37:38.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = b84216cc-8205-4103-9c8a-e86cf8dba69b response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76122024-12-20T21:37:39.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 93 reason = Timeout
76132024-12-20T21:37:39.541ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 93 reason = Timeout
76142024-12-20T21:37:39.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76152024-12-20T21:37:39.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76162024-12-20T21:37:39.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76172024-12-20T21:37:39.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76182024-12-20T21:37:39.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76192024-12-20T21:37:39.543ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76202024-12-20T21:37:39.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76212024-12-20T21:37:39.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76222024-12-20T21:37:39.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76232024-12-20T21:37:39.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76242024-12-20T21:37:39.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76252024-12-20T21:37:39.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76262024-12-20T21:37:39.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76272024-12-20T21:37:39.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
76282024-12-20T21:37:39.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76292024-12-20T21:37:39.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76302024-12-20T21:37:39.561ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
76312024-12-20T21:37:39.561ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.015849ms iteration = 93 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
76322024-12-20T21:37:39.570ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.872758ms iteration = 93 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76332024-12-20T21:37:39.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 14b1f44c-a80a-4c36-8e70-e00ca0d41cac roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76342024-12-20T21:37:39.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 14b1f44c-a80a-4c36-8e70-e00ca0d41cac resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76352024-12-20T21:37:39.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2012 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 14b1f44c-a80a-4c36-8e70-e00ca0d41cac response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76362024-12-20T21:37:40.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5214b5b2-85bc-4614-a922-affe695b94d6 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76372024-12-20T21:37:40.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5214b5b2-85bc-4614-a922-affe695b94d6 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76382024-12-20T21:37:40.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 5214b5b2-85bc-4614-a922-affe695b94d6 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76392024-12-20T21:37:41.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 031af9d2-6951-454b-8be6-b668cb5ba1b2 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76402024-12-20T21:37:41.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 031af9d2-6951-454b-8be6-b668cb5ba1b2 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76412024-12-20T21:37:41.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 031af9d2-6951-454b-8be6-b668cb5ba1b2 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76422024-12-20T21:37:42.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = dcec1692-728f-4acb-943d-8f62675de87f roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76432024-12-20T21:37:42.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = dcec1692-728f-4acb-943d-8f62675de87f resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76442024-12-20T21:37:42.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = dcec1692-728f-4acb-943d-8f62675de87f response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76452024-12-20T21:37:43.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3985af6c-3d9c-4d10-94c0-fe88b332295c roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76462024-12-20T21:37:43.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3985af6c-3d9c-4d10-94c0-fe88b332295c resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76472024-12-20T21:37:43.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3985af6c-3d9c-4d10-94c0-fe88b332295c response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76482024-12-20T21:37:44.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 30338016-df7b-4250-a493-fccea575ab9e roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76492024-12-20T21:37:44.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 30338016-df7b-4250-a493-fccea575ab9e resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76502024-12-20T21:37:44.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2564 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 30338016-df7b-4250-a493-fccea575ab9e response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76512024-12-20T21:37:45.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6e66a097-a478-4b91-a710-026b00c8fe12 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76522024-12-20T21:37:45.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6e66a097-a478-4b91-a710-026b00c8fe12 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76532024-12-20T21:37:45.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 6e66a097-a478-4b91-a710-026b00c8fe12 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76542024-12-20T21:37:46.408ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 567 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 93187011-7f7a-49b7-a13a-acafe348d5e5 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
76552024-12-20T21:37:46.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7ea9f9b8-c7cc-43fe-8af8-fe74a2c31b8d roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76562024-12-20T21:37:46.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7ea9f9b8-c7cc-43fe-8af8-fe74a2c31b8d resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76572024-12-20T21:37:46.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 7ea9f9b8-c7cc-43fe-8af8-fe74a2c31b8d response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76582024-12-20T21:37:47.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 7d4e0d91-6953-45b0-84d5-263df5ed35b0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
76592024-12-20T21:37:47.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 7d4e0d91-6953-45b0-84d5-263df5ed35b0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
76602024-12-20T21:37:47.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43551 req_id = 7d4e0d91-6953-45b0-84d5-263df5ed35b0 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
76612024-12-20T21:37:47.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bd1a5fcb-e48b-4519-84b0-9e3b44ae88ac roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76622024-12-20T21:37:47.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bd1a5fcb-e48b-4519-84b0-9e3b44ae88ac resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76632024-12-20T21:37:47.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2772 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = bd1a5fcb-e48b-4519-84b0-9e3b44ae88ac response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76642024-12-20T21:37:48.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c72641da-9d02-4cc9-8d16-ee2627feb68b roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76652024-12-20T21:37:48.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c72641da-9d02-4cc9-8d16-ee2627feb68b resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76662024-12-20T21:37:48.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2416 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = c72641da-9d02-4cc9-8d16-ee2627feb68b response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
76672024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 94 reason = Timeout
76682024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 32 reason = Timeout
76692024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76702024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76712024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 35 reason = Timeout
76722024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76732024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 33 reason = Timeout
76742024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76752024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 32 reason = Timeout
76762024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
76772024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 32 reason = Timeout
76782024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76792024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76802024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 32 reason = Timeout
76812024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76822024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 32 reason = Timeout
76832024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
76842024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 32 reason = Timeout
76852024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76862024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 32 reason = Timeout
76872024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76882024-12-20T21:37:49.540ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 32 reason = Timeout
76892024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 94 reason = Timeout
76902024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 32 reason = Timeout
76912024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76922024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 32 reason = Timeout
76932024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
76942024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
76952024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 33 reason = Timeout
76962024-12-20T21:37:49.541ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
76972024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76982024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 32 reason = Timeout
76992024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 32 reason = Timeout
77002024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77012024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77022024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77032024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77042024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77052024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77062024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
77072024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77082024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77092024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
77102024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77112024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77122024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77132024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77142024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
77152024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77162024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77172024-12-20T21:37:49.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77182024-12-20T21:37:49.543ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77192024-12-20T21:37:49.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77202024-12-20T21:37:49.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77212024-12-20T21:37:49.544ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.702723ms iteration = 32 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
77222024-12-20T21:37:49.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77232024-12-20T21:37:49.545ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77242024-12-20T21:37:49.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77252024-12-20T21:37:49.546ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1768, tv_nsec: 823786964 } })
77262024-12-20T21:37:49.546ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
77272024-12-20T21:37:49.547ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1768, tv_nsec: 824629733 } })
77282024-12-20T21:37:49.547ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
77292024-12-20T21:37:49.549ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77302024-12-20T21:37:49.549ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77312024-12-20T21:37:49.551ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77322024-12-20T21:37:49.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
77332024-12-20T21:37:49.552ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77342024-12-20T21:37:49.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77352024-12-20T21:37:49.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
77362024-12-20T21:37:49.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77372024-12-20T21:37:49.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77382024-12-20T21:37:49.553ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77392024-12-20T21:37:49.553ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77402024-12-20T21:37:49.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77412024-12-20T21:37:49.555ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77422024-12-20T21:37:49.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77432024-12-20T21:37:49.560ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77442024-12-20T21:37:49.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77452024-12-20T21:37:49.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77462024-12-20T21:37:49.561ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c74ff24-982c-40fd-86fd-ef04898c5922.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1768, tv_nsec: 838894492 } })
77472024-12-20T21:37:49.561ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
77482024-12-20T21:37:49.562ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77492024-12-20T21:37:49.563ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77502024-12-20T21:37:49.563ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77512024-12-20T21:37:49.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77522024-12-20T21:37:49.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77532024-12-20T21:37:49.564ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77542024-12-20T21:37:49.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77552024-12-20T21:37:49.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 38.32136ms iteration = 32 status = {"errors":[],"garbage_collect_requested":[]}
77562024-12-20T21:37:49.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77572024-12-20T21:37:49.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77582024-12-20T21:37:49.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 39.944436ms iteration = 32 status = {"errors":[],"finish_invoked_ok":[]}
77592024-12-20T21:37:49.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77602024-12-20T21:37:49.586ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77612024-12-20T21:37:49.586ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77622024-12-20T21:37:49.586ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
77632024-12-20T21:37:49.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77642024-12-20T21:37:49.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77652024-12-20T21:37:49.586ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77662024-12-20T21:37:49.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77672024-12-20T21:37:49.587ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
77682024-12-20T21:37:49.587ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 46.446212ms iteration = 32 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
77692024-12-20T21:37:49.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77702024-12-20T21:37:49.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77712024-12-20T21:37:49.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77722024-12-20T21:37:49.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
77732024-12-20T21:37:49.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77742024-12-20T21:37:49.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77752024-12-20T21:37:49.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77762024-12-20T21:37:49.591ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.970653ms iteration = 94 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77772024-12-20T21:37:49.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77782024-12-20T21:37:49.592ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77792024-12-20T21:37:49.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77802024-12-20T21:37:49.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77812024-12-20T21:37:49.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77822024-12-20T21:37:49.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77832024-12-20T21:37:49.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
77842024-12-20T21:37:49.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77852024-12-20T21:37:49.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77862024-12-20T21:37:49.610ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
77872024-12-20T21:37:49.610ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 69.056749ms iteration = 94 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
77882024-12-20T21:37:49.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 70.427569ms iteration = 32 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
77892024-12-20T21:37:49.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77902024-12-20T21:37:49.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77912024-12-20T21:37:49.621ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
77922024-12-20T21:37:49.621ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77932024-12-20T21:37:49.621ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
77942024-12-20T21:37:49.621ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77952024-12-20T21:37:49.621ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "40e62284-33e9-40da-a1b6-d829fa3564f3", "content-length": "26", "date": "Fri, 20 Dec 2024 21:37:49 GMT"} })
77962024-12-20T21:37:49.622ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77972024-12-20T21:37:49.622ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "abe35176-28e8-48f9-ba60-78318c65ecaa", "content-length": "26", "date": "Fri, 20 Dec 2024 21:37:49 GMT"} })
77982024-12-20T21:37:49.622ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77992024-12-20T21:37:49.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78002024-12-20T21:37:49.624ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78012024-12-20T21:37:49.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78022024-12-20T21:37:49.624ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78032024-12-20T21:37:49.626ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78042024-12-20T21:37:49.627ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78052024-12-20T21:37:49.627ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
78062024-12-20T21:37:49.627ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78072024-12-20T21:37:49.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78082024-12-20T21:37:49.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c74ff24-982c-40fd-86fd-ef04898c5922, lookup_type: ById(8c74ff24-982c-40fd-86fd-ef04898c5922) } result = Ok(())
78092024-12-20T21:37:49.629ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78102024-12-20T21:37:49.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78112024-12-20T21:37:49.631ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78122024-12-20T21:37:49.631ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 90.187932ms iteration = 32 status = 0
78132024-12-20T21:37:49.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78142024-12-20T21:37:49.634ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.577618ms iteration = 32 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
78152024-12-20T21:37:49.647ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac zone_address = fd00:1122:3344:101::2
78162024-12-20T21:37:49.647ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78172024-12-20T21:37:49.648ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f66a8af-f202-4c61-80f8-16e9dc9475e7", "content-length": "26", "date": "Fri, 20 Dec 2024 21:37:49 GMT"} })
78182024-12-20T21:37:49.648ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78192024-12-20T21:37:49.650ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
78202024-12-20T21:37:49.659ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78212024-12-20T21:37:49.659ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
78222024-12-20T21:37:49.659ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 118.961857ms iteration = 32 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
78232024-12-20T21:37:49.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78242024-12-20T21:37:49.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78252024-12-20T21:37:49.669ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 128.242026ms iteration = 32 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
78262024-12-20T21:37:49.674ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 133.192466ms iteration = 35 status = {"physical_disks_added":0}
78272024-12-20T21:37:49.689ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78282024-12-20T21:37:49.691ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78292024-12-20T21:37:49.691ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78302024-12-20T21:37:49.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78312024-12-20T21:37:49.726ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
78322024-12-20T21:37:49.726ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b94c2791-9bb7-44d5-b50f-02e8c0abc991", "content-length": "2", "date": "Fri, 20 Dec 2024 21:37:49 GMT"} })
78332024-12-20T21:37:49.728ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78342024-12-20T21:37:49.729ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 188.093697ms iteration = 32 status = {}
78352024-12-20T21:37:49.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78362024-12-20T21:37:49.738ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
78372024-12-20T21:37:49.738ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78382024-12-20T21:37:49.738ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "593b10ff-3b3e-4e94-93ec-559c3ee96393", "content-length": "372", "date": "Fri, 20 Dec 2024 21:37:49 GMT"} })
78392024-12-20T21:37:49.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78402024-12-20T21:37:49.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78412024-12-20T21:37:49.740ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 199.468753ms iteration = 32 status = null
78422024-12-20T21:37:49.767ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78432024-12-20T21:37:49.769ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78442024-12-20T21:37:49.769ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78452024-12-20T21:37:49.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78462024-12-20T21:37:49.785ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
78472024-12-20T21:37:49.785ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
78482024-12-20T21:37:49.785ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4c205253-b535-46f4-a047-fcee2e08cec4", "date": "Fri, 20 Dec 2024 21:37:49 GMT"} })
78492024-12-20T21:37:49.785ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78502024-12-20T21:37:49.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78512024-12-20T21:37:49.788ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78522024-12-20T21:37:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78532024-12-20T21:37:49.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78542024-12-20T21:37:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78552024-12-20T21:37:49.794ZINFOnexus (BackgroundTasks): VPC route manager sled 8c74ff24-982c-40fd-86fd-ef04898c5922 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
78562024-12-20T21:37:49.794ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78572024-12-20T21:37:49.795ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e6fddafc-465d-451b-b230-330101b1ba82", "date": "Fri, 20 Dec 2024 21:37:49 GMT"} })
78582024-12-20T21:37:49.796ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 255.854358ms iteration = 33 status = {}
78592024-12-20T21:37:49.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78602024-12-20T21:37:49.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78612024-12-20T21:37:49.807ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 583388f4-92af-4a10-817c-62f2e9571310, rack_id: a7e68df9-95f5-4fda-aae0-2f46483e29ac, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bacaa666-9eda-4bc8-9ccd-35df228fd476) } rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
78622024-12-20T21:37:49.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78632024-12-20T21:37:49.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78642024-12-20T21:37:49.816ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
78652024-12-20T21:37:49.817ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba4d8dc4-fa0d-4027-9ad0-689aa149dae8", "content-length": "134", "date": "Fri, 20 Dec 2024 21:37:49 GMT"} })
78662024-12-20T21:37:49.817ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
78672024-12-20T21:37:49.817ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bacaa666-9eda-4bc8-9ccd-35df228fd476
78682024-12-20T21:37:49.817ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
78692024-12-20T21:37:49.817ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
78702024-12-20T21:37:49.817ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78712024-12-20T21:37:49.817ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78722024-12-20T21:37:49.817ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78732024-12-20T21:37:49.817ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78742024-12-20T21:37:49.817ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78752024-12-20T21:37:49.817ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78762024-12-20T21:37:49.817ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac
78772024-12-20T21:37:49.817ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78782024-12-20T21:37:49.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78792024-12-20T21:37:49.819ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
78802024-12-20T21:37:49.820ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce2ca6c1-ad61-4395-b34a-28f65cf6b32a", "content-length": "2", "date": "Fri, 20 Dec 2024 21:37:49 GMT"} })
78812024-12-20T21:37:49.820ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
78822024-12-20T21:37:49.820ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ce2d950-d8b4-4fc1-871c-286cee984f80", "content-length": "52", "date": "Fri, 20 Dec 2024 21:37:49 GMT"} })
78832024-12-20T21:37:49.820ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch_location = Switch0
78842024-12-20T21:37:49.820ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
78852024-12-20T21:37:49.856ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
78862024-12-20T21:37:49.937ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d16a7fa1-7bdd-4bca-b0c3-90513c6a65c8", "date": "Fri, 20 Dec 2024 21:37:49 GMT"} })
78872024-12-20T21:37:49.937ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac switch = Switch0
78882024-12-20T21:37:49.937ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
78892024-12-20T21:37:49.937ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c74ff24-982c-40fd-86fd-ef04898c5922 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b99765f-10a8-4928-811f-57acb26bebc3", "content-length": "691", "date": "Fri, 20 Dec 2024 21:37:49 GMT"} })
78902024-12-20T21:37:49.937ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
78912024-12-20T21:37:49.937ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
78922024-12-20T21:37:49.937ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
78932024-12-20T21:37:49.937ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a7e68df9-95f5-4fda-aae0-2f46483e29ac result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8f31144-9ed2-4d9b-937f-c0da7e1872e2", "content-length": "682", "date": "Fri, 20 Dec 2024 21:37:49 GMT"} })
78942024-12-20T21:37:49.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78952024-12-20T21:37:49.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78962024-12-20T21:37:49.942ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 401.705027ms iteration = 33 status = {}
78972024-12-20T21:37:49.945ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78982024-12-20T21:37:49.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78992024-12-20T21:37:49.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = be60c3ca-68ec-491a-9ea2-4cc4f141d1f1 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79002024-12-20T21:37:49.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = be60c3ca-68ec-491a-9ea2-4cc4f141d1f1 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79012024-12-20T21:37:49.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1987 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = be60c3ca-68ec-491a-9ea2-4cc4f141d1f1 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79022024-12-20T21:37:49.948ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79032024-12-20T21:37:49.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79042024-12-20T21:37:49.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79052024-12-20T21:37:49.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79062024-12-20T21:37:49.958ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 417.251856ms iteration = 32 status = {}
79072024-12-20T21:37:50.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 971a3d3d-d5fc-4b14-b67b-6aa9dddd2924 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79082024-12-20T21:37:50.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 971a3d3d-d5fc-4b14-b67b-6aa9dddd2924 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79092024-12-20T21:37:50.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 971a3d3d-d5fc-4b14-b67b-6aa9dddd2924 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79102024-12-20T21:37:51.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a51fa7cd-5afa-4fab-b4eb-0bf4632dc6dd roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79112024-12-20T21:37:51.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a51fa7cd-5afa-4fab-b4eb-0bf4632dc6dd resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79122024-12-20T21:37:51.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = a51fa7cd-5afa-4fab-b4eb-0bf4632dc6dd response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79132024-12-20T21:37:53.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ed61d766-291d-4c7e-bfe4-977619dbb8f6 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79142024-12-20T21:37:53.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ed61d766-291d-4c7e-bfe4-977619dbb8f6 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79152024-12-20T21:37:53.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = ed61d766-291d-4c7e-bfe4-977619dbb8f6 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79162024-12-20T21:37:54.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 17289166-a30f-478e-9f06-c798e5589944 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79172024-12-20T21:37:54.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 17289166-a30f-478e-9f06-c798e5589944 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79182024-12-20T21:37:54.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 17289166-a30f-478e-9f06-c798e5589944 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79192024-12-20T21:37:55.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9b1843ab-752b-4725-a00f-0e27d9aa0c74 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79202024-12-20T21:37:55.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9b1843ab-752b-4725-a00f-0e27d9aa0c74 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79212024-12-20T21:37:55.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2896 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 9b1843ab-752b-4725-a00f-0e27d9aa0c74 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79222024-12-20T21:37:56.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 73c24f1e-9f8e-4a7a-bbe7-08d2f09d0a35 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79232024-12-20T21:37:56.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 73c24f1e-9f8e-4a7a-bbe7-08d2f09d0a35 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79242024-12-20T21:37:56.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 73c24f1e-9f8e-4a7a-bbe7-08d2f09d0a35 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79252024-12-20T21:37:56.407ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 657 local_addr = [fd00:1122:3344:101::b]:51378 method = GET remote_addr = [fd00:1122:3344:101::d]:32768 req_id = 30f3d71a-d85c-4c88-a37f-83e605471741 response_code = 200 uri = /12bea37a-3ccb-4c9f-8c92-9d6095867a0f
79262024-12-20T21:37:57.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3f7a032b-8aaa-4406-b7f4-5cf584bd559f roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79272024-12-20T21:37:57.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3f7a032b-8aaa-4406-b7f4-5cf584bd559f resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79282024-12-20T21:37:57.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 3f7a032b-8aaa-4406-b7f4-5cf584bd559f response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79292024-12-20T21:37:58.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4c1f5cdc-84f4-456d-9964-94633c73ff7a roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79302024-12-20T21:37:58.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4c1f5cdc-84f4-456d-9964-94633c73ff7a resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79312024-12-20T21:37:58.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2641 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 4c1f5cdc-84f4-456d-9964-94633c73ff7a response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79322024-12-20T21:37:59.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 18caacba-176c-4c07-b7a2-fd09d8d47c6a roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79332024-12-20T21:37:59.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 18caacba-176c-4c07-b7a2-fd09d8d47c6a resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79342024-12-20T21:37:59.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2751 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 18caacba-176c-4c07-b7a2-fd09d8d47c6a response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79352024-12-20T21:37:59.540ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 95 reason = Timeout
79362024-12-20T21:37:59.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79372024-12-20T21:37:59.540ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 95 reason = Timeout
79382024-12-20T21:37:59.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79392024-12-20T21:37:59.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79402024-12-20T21:37:59.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79412024-12-20T21:37:59.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79422024-12-20T21:37:59.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79432024-12-20T21:37:59.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79442024-12-20T21:37:59.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79452024-12-20T21:37:59.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79462024-12-20T21:37:59.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79472024-12-20T21:37:59.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79482024-12-20T21:37:59.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9112287e-7109-46ca-aa8a-610048d83c82, lookup_type: ById(9112287e-7109-46ca-aa8a-610048d83c82) } result = Ok(())
79492024-12-20T21:37:59.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79502024-12-20T21:37:59.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79512024-12-20T21:37:59.560ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9112287e-7109-46ca-aa8a-610048d83c82 original_time_created = 2024-12-20 21:22:06.914114 UTC target_id = 9112287e-7109-46ca-aa8a-610048d83c82 time_created = 2024-12-20 21:22:06.914114 UTC
79522024-12-20T21:37:59.560ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.210743ms iteration = 95 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9112287e-7109-46ca-aa8a-610048d83c82","time_created":"2024-12-20T21:22:06.914114Z"}
79532024-12-20T21:37:59.568ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79542024-12-20T21:37:59.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79552024-12-20T21:37:59.595ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.208518ms iteration = 95 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79562024-12-20T21:38:00.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 956e4d69-dc35-48fe-ad96-cb9a3476d816 roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79572024-12-20T21:38:00.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 956e4d69-dc35-48fe-ad96-cb9a3476d816 resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79582024-12-20T21:38:00.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 956e4d69-dc35-48fe-ad96-cb9a3476d816 response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79592024-12-20T21:38:01.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2e58c8f5-d955-4d35-8109-91bac73aac1f roles = RoleSet { roles: {} } uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79602024-12-20T21:38:01.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2e58c8f5-d955-4d35-8109-91bac73aac1f resource = Database result = Ok(()) uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922
79612024-12-20T21:38:01.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:64941 req_id = 2e58c8f5-d955-4d35-8109-91bac73aac1f response_code = 200 uri = /probes/8c74ff24-982c-40fd-86fd-ef04898c5922