Max level shown:
12024-09-16T14:45:00.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 0b240399-39dc-4bec-8e6d-fdad3a69555f roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
22024-09-16T14:45:00.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 0b240399-39dc-4bec-8e6d-fdad3a69555f resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
32024-09-16T14:45:00.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2570 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 0b240399-39dc-4bec-8e6d-fdad3a69555f response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
42024-09-16T14:45:01.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
52024-09-16T14:45:01.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
62024-09-16T14:45:01.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72024-09-16T14:45:01.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82024-09-16T14:45:01.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92024-09-16T14:45:01.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102024-09-16T14:45:01.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112024-09-16T14:45:01.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122024-09-16T14:45:01.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132024-09-16T14:45:01.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
142024-09-16T14:45:01.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
152024-09-16T14:45:01.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
162024-09-16T14:45:01.559ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.589566ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
172024-09-16T14:45:01.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
182024-09-16T14:45:01.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
192024-09-16T14:45:01.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
202024-09-16T14:45:01.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
212024-09-16T14:45:01.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
222024-09-16T14:45:01.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
232024-09-16T14:45:01.575ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
242024-09-16T14:45:01.575ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.366927ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
252024-09-16T14:45:01.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 85f985e0-faa0-4be2-8f3b-0b89234cf4f0 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
262024-09-16T14:45:01.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 85f985e0-faa0-4be2-8f3b-0b89234cf4f0 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
272024-09-16T14:45:01.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2478 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 85f985e0-faa0-4be2-8f3b-0b89234cf4f0 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
282024-09-16T14:45:02.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a30528f8-0273-4155-ac27-b6b380b237b1 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
292024-09-16T14:45:02.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a30528f8-0273-4155-ac27-b6b380b237b1 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
302024-09-16T14:45:02.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a30528f8-0273-4155-ac27-b6b380b237b1 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
312024-09-16T14:45:04.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 41c78df7-4df9-4648-a2dc-1e6002bf1633 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
322024-09-16T14:45:04.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 41c78df7-4df9-4648-a2dc-1e6002bf1633 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
332024-09-16T14:45:04.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2553 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 41c78df7-4df9-4648-a2dc-1e6002bf1633 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
342024-09-16T14:45:04.685ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:35652
352024-09-16T14:45:04.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35652 req_id = 5b271aec-65ef-4162-8da8-6437b0846ff5 roles = RoleSet { roles: {} } uri = /metrics/producers
362024-09-16T14:45:04.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35652 req_id = 5b271aec-65ef-4162-8da8-6437b0846ff5 resource = Database result = Ok(()) uri = /metrics/producers
372024-09-16T14:45:04.726ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d9cae32d-8e84-4f97-9d87-f815a97563b7
382024-09-16T14:45:04.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35652 req_id = 5b271aec-65ef-4162-8da8-6437b0846ff5 roles = RoleSet { roles: {} } uri = /metrics/producers
392024-09-16T14:45:04.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35652 req_id = 5b271aec-65ef-4162-8da8-6437b0846ff5 resource = Database result = Ok(()) uri = /metrics/producers
402024-09-16T14:45:04.770ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 uri = http://[fd00:1122:3344:101::d]:12223/producers
412024-09-16T14:45:04.770ZDEBGnexus: client response oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d868fc35-f2d9-4780-96d7-f1641edab158", "date": "Mon, 16 Sep 2024 14:45:04 GMT"} })
422024-09-16T14:45:04.770ZINFOnexus: assigned collector to new producer collector_id = d9cae32d-8e84-4f97-9d87-f815a97563b7 file = nexus/src/app/oximeter.rs:125 producer_id = ab94c385-d2ae-4032-9ac3-7db416af9813
432024-09-16T14:45:04.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 86357 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35652 req_id = 5b271aec-65ef-4162-8da8-6437b0846ff5 response_code = 201 uri = /metrics/producers
442024-09-16T14:45:05.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 602af745-12b1-42a5-a613-d21768972cac roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
452024-09-16T14:45:05.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 602af745-12b1-42a5-a613-d21768972cac resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
462024-09-16T14:45:05.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1890 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 602af745-12b1-42a5-a613-d21768972cac response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
472024-09-16T14:45:05.736ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1850 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = 59a9db65-ea28-48c3-a5f8-392df47af3ff response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
482024-09-16T14:45:06.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 2167dad4-3402-41e0-b10c-fa6bb22870e2 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
492024-09-16T14:45:06.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 2167dad4-3402-41e0-b10c-fa6bb22870e2 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
502024-09-16T14:45:06.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 2167dad4-3402-41e0-b10c-fa6bb22870e2 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
512024-09-16T14:45:07.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = ada9e091-417c-4ae4-b4c0-b74acd895ec6 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
522024-09-16T14:45:07.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = ada9e091-417c-4ae4-b4c0-b74acd895ec6 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
532024-09-16T14:45:07.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = ada9e091-417c-4ae4-b4c0-b74acd895ec6 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
542024-09-16T14:45:08.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 371e9ff0-9892-4f91-a345-85481fc42ec6 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
552024-09-16T14:45:08.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 371e9ff0-9892-4f91-a345-85481fc42ec6 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
562024-09-16T14:45:08.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 371e9ff0-9892-4f91-a345-85481fc42ec6 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
572024-09-16T14:45:09.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 58b20007-ad70-4f5c-81ca-689060d51791 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
582024-09-16T14:45:09.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 58b20007-ad70-4f5c-81ca-689060d51791 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
592024-09-16T14:45:09.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 58b20007-ad70-4f5c-81ca-689060d51791 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
602024-09-16T14:45:10.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = afb03077-802d-4c3a-ad73-b6ca6d39188e roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
612024-09-16T14:45:10.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = afb03077-802d-4c3a-ad73-b6ca6d39188e resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
622024-09-16T14:45:10.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2759 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = afb03077-802d-4c3a-ad73-b6ca6d39188e response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
632024-09-16T14:45:11.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 89eca1f5-ca07-4c6f-be74-89f0a17f9612 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
642024-09-16T14:45:11.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 89eca1f5-ca07-4c6f-be74-89f0a17f9612 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
652024-09-16T14:45:11.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 89eca1f5-ca07-4c6f-be74-89f0a17f9612 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
662024-09-16T14:45:11.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
672024-09-16T14:45:11.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
682024-09-16T14:45:11.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
692024-09-16T14:45:11.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
702024-09-16T14:45:11.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
712024-09-16T14:45:11.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
722024-09-16T14:45:11.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
732024-09-16T14:45:11.556ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
742024-09-16T14:45:11.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
752024-09-16T14:45:11.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
762024-09-16T14:45:11.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
772024-09-16T14:45:11.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
782024-09-16T14:45:11.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
792024-09-16T14:45:11.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
802024-09-16T14:45:11.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
812024-09-16T14:45:11.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
822024-09-16T14:45:11.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
832024-09-16T14:45:11.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
842024-09-16T14:45:11.574ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
852024-09-16T14:45:11.574ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.269786ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
862024-09-16T14:45:11.588ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.519667ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
872024-09-16T14:45:12.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 629a708c-72d3-4eb9-a9bb-657321023094 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
882024-09-16T14:45:12.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 629a708c-72d3-4eb9-a9bb-657321023094 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
892024-09-16T14:45:12.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 629a708c-72d3-4eb9-a9bb-657321023094 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
902024-09-16T14:45:13.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 55e61946-4649-4ab0-b671-12b996eaa005 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
912024-09-16T14:45:13.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 55e61946-4649-4ab0-b671-12b996eaa005 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
922024-09-16T14:45:13.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1665 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 55e61946-4649-4ab0-b671-12b996eaa005 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
932024-09-16T14:45:14.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 2c910457-ef11-4cf8-9177-ca274825caeb roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
942024-09-16T14:45:14.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 2c910457-ef11-4cf8-9177-ca274825caeb resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
952024-09-16T14:45:14.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 2c910457-ef11-4cf8-9177-ca274825caeb response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
962024-09-16T14:45:15.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5da9e9e7-4372-4474-81bc-d64eb897953c roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
972024-09-16T14:45:15.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5da9e9e7-4372-4474-81bc-d64eb897953c resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
982024-09-16T14:45:15.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5da9e9e7-4372-4474-81bc-d64eb897953c response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
992024-09-16T14:45:15.736ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1907 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = 05bb0b1e-1297-4eb4-bf0a-5a1c37acdccb response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
1002024-09-16T14:45:16.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = dca6ca50-26ae-49d4-bc3d-0ba5f7e4ed76 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
1012024-09-16T14:45:16.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = dca6ca50-26ae-49d4-bc3d-0ba5f7e4ed76 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
1022024-09-16T14:45:16.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = dca6ca50-26ae-49d4-bc3d-0ba5f7e4ed76 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
1032024-09-16T14:45:17.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 70871b6c-a344-4a6f-9c34-71b77dcf09e7 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
1042024-09-16T14:45:17.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 70871b6c-a344-4a6f-9c34-71b77dcf09e7 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
1052024-09-16T14:45:17.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 70871b6c-a344-4a6f-9c34-71b77dcf09e7 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
1062024-09-16T14:45:18.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 29b878f5-e64b-48ec-9d2f-054d672b7fcc roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
1072024-09-16T14:45:18.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 29b878f5-e64b-48ec-9d2f-054d672b7fcc resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
1082024-09-16T14:45:18.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 29b878f5-e64b-48ec-9d2f-054d672b7fcc response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
1092024-09-16T14:45:19.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = dd8ed45f-27fa-4529-b407-61c26d268e1d roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
1102024-09-16T14:45:19.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = dd8ed45f-27fa-4529-b407-61c26d268e1d resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
1112024-09-16T14:45:19.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2645 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = dd8ed45f-27fa-4529-b407-61c26d268e1d response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
1122024-09-16T14:45:20.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d6c90b2c-08bf-4c76-b644-097b4ce32ef0 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
1132024-09-16T14:45:20.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d6c90b2c-08bf-4c76-b644-097b4ce32ef0 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
1142024-09-16T14:45:20.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d6c90b2c-08bf-4c76-b644-097b4ce32ef0 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
1152024-09-16T14:45:21.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a4e5923f-f8ca-4b0d-a636-2dbdfaa806b8 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
1162024-09-16T14:45:21.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a4e5923f-f8ca-4b0d-a636-2dbdfaa806b8 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
1172024-09-16T14:45:21.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a4e5923f-f8ca-4b0d-a636-2dbdfaa806b8 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
1182024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
1192024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
1202024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1212024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1222024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
1232024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1242024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
1252024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
1262024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1272024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
1282024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
1292024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1302024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1312024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
1322024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
1332024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1342024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1352024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1362024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
1372024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1382024-09-16T14:45:21.554ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-16 14:35:21.554755269 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1392024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1402024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
1412024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1422024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
1432024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1442024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
1452024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1462024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
1472024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
1482024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1492024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
1502024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1512024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
1522024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1532024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
1542024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1552024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
1562024-09-16T14:45:21.554ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2
1572024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.65\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2"}
1582024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
1592024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
1602024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1612024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
1622024-09-16T14:45:21.554ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
1632024-09-16T14:45:21.554ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
1642024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
1652024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1662024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1672024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1682024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
1692024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
1702024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
1712024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
1722024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1732024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1742024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1752024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
1762024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1772024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1782024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1792024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1802024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1812024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1822024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1832024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1842024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1852024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1862024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1872024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1882024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1892024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1902024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1912024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1922024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1932024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1942024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
1952024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1962024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1972024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1982024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1992024-09-16T14:45:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2002024-09-16T14:45:21.555ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0839d410-88e5-4168-91a3-1340a5d7a912.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f93623c-a4f4-43d1-b285-fdbdeccdc7e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fc6cb4c7-5a91-4879-8aba-57c83b2f5553.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fc6cb4c7-5a91-4879-8aba-57c83b2f5553.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 24010, tv_nsec: 514418021 } })
2012024-09-16T14:45:21.555ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("216291e2-64d0-4e57-82ea-84523304c97b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fcbfd0d4-0b48-4392-95df-b0bdb2c97118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fcbfd0d4-0b48-4392-95df-b0bdb2c97118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 24010, tv_nsec: 514434441 } })
2022024-09-16T14:45:21.556ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
2032024-09-16T14:45:21.556ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.853475ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
2042024-09-16T14:45:21.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2052024-09-16T14:45:21.557ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
2062024-09-16T14:45:21.557ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.733022ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
2072024-09-16T14:45:21.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2082024-09-16T14:45:21.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2092024-09-16T14:45:21.559ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24010, tv_nsec: 517800115 } })
2102024-09-16T14:45:21.559ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
2112024-09-16T14:45:21.559ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
2122024-09-16T14:45:21.559ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2132024-09-16T14:45:21.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2142024-09-16T14:45:21.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2152024-09-16T14:45:21.559ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-16 14:35:21.554755269 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
2162024-09-16T14:45:21.559ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.151668ms iteration = 5 status = {"expiration":"2024-09-16T14:35:21.554755269Z","pruned":[]}
2172024-09-16T14:45:21.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2182024-09-16T14:45:21.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2192024-09-16T14:45:21.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2202024-09-16T14:45:21.561ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.604506ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
2212024-09-16T14:45:21.561ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2222024-09-16T14:45:21.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2232024-09-16T14:45:21.563ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2242024-09-16T14:45:21.563ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2252024-09-16T14:45:21.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2262024-09-16T14:45:21.564ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2272024-09-16T14:45:21.564ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2282024-09-16T14:45:21.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2292024-09-16T14:45:21.565ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.785375ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
2302024-09-16T14:45:21.567ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2312024-09-16T14:45:21.568ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2322024-09-16T14:45:21.568ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24010, tv_nsec: 527688394 } })
2332024-09-16T14:45:21.569ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2342024-09-16T14:45:21.569ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2352024-09-16T14:45:21.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2362024-09-16T14:45:21.569ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
2372024-09-16T14:45:21.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2382024-09-16T14:45:21.570ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2392024-09-16T14:45:21.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2402024-09-16T14:45:21.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2412024-09-16T14:45:21.572ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2422024-09-16T14:45:21.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2432024-09-16T14:45:21.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2442024-09-16T14:45:21.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2452024-09-16T14:45:21.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2462024-09-16T14:45:21.577ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
2472024-09-16T14:45:21.577ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
2482024-09-16T14:45:21.577ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
2492024-09-16T14:45:21.577ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2502024-09-16T14:45:21.577ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2512024-09-16T14:45:21.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2522024-09-16T14:45:21.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2532024-09-16T14:45:21.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2542024-09-16T14:45:21.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2552024-09-16T14:45:21.584ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2562024-09-16T14:45:21.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2572024-09-16T14:45:21.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2582024-09-16T14:45:21.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2592024-09-16T14:45:21.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2602024-09-16T14:45:21.585ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2612024-09-16T14:45:21.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2622024-09-16T14:45:21.585ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:539 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2632024-09-16T14:45:21.585ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 31.299886ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2642024-09-16T14:45:21.586ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2652024-09-16T14:45:21.586ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2662024-09-16T14:45:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2672024-09-16T14:45:21.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2682024-09-16T14:45:21.588ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2692024-09-16T14:45:21.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2702024-09-16T14:45:21.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2712024-09-16T14:45:21.590ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2722024-09-16T14:45:21.590ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2732024-09-16T14:45:21.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2742024-09-16T14:45:21.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
2752024-09-16T14:45:21.594ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2762024-09-16T14:45:21.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2772024-09-16T14:45:21.595ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2782024-09-16T14:45:21.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2792024-09-16T14:45:21.598ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 43.489349ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
2802024-09-16T14:45:21.598ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2812024-09-16T14:45:21.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2822024-09-16T14:45:21.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2832024-09-16T14:45:21.603ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.068626ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
2842024-09-16T14:45:21.604ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
2852024-09-16T14:45:21.604ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
2862024-09-16T14:45:21.604ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 49.309449ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
2872024-09-16T14:45:21.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2882024-09-16T14:45:21.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2892024-09-16T14:45:21.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2902024-09-16T14:45:21.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2912024-09-16T14:45:21.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2922024-09-16T14:45:21.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2932024-09-16T14:45:21.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2942024-09-16T14:45:21.612ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24010, tv_nsec: 571016389 } })
2952024-09-16T14:45:21.614ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
2962024-09-16T14:45:21.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2972024-09-16T14:45:21.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2982024-09-16T14:45:21.618ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2992024-09-16T14:45:21.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
3002024-09-16T14:45:21.620ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3012024-09-16T14:45:21.622ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 67.357953ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
3022024-09-16T14:45:21.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3032024-09-16T14:45:21.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
3042024-09-16T14:45:21.623ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
3052024-09-16T14:45:21.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
3062024-09-16T14:45:21.624ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
3072024-09-16T14:45:21.624ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
3082024-09-16T14:45:21.624ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
3092024-09-16T14:45:21.624ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3102024-09-16T14:45:21.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3112024-09-16T14:45:21.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
3122024-09-16T14:45:21.626ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3132024-09-16T14:45:21.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3142024-09-16T14:45:21.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.647804ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3152024-09-16T14:45:21.628ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
3162024-09-16T14:45:21.628ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3172024-09-16T14:45:21.628ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3182024-09-16T14:45:21.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3192024-09-16T14:45:21.629ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3202024-09-16T14:45:21.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3212024-09-16T14:45:21.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3222024-09-16T14:45:21.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3232024-09-16T14:45:21.636ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3242024-09-16T14:45:21.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3252024-09-16T14:45:21.640ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3262024-09-16T14:45:21.641ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3272024-09-16T14:45:21.641ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 01c7aafc-c1b7-42bb-a493-0c643f2e21db dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3282024-09-16T14:45:21.641ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3292024-09-16T14:45:21.641ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3302024-09-16T14:45:21.641ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d70d9c11-14c5-40d0-be17-039af1ae521e dns_zone_name = oxide.test found_so_far = 0 version = 2
3312024-09-16T14:45:21.641ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3322024-09-16T14:45:21.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3332024-09-16T14:45:21.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3342024-09-16T14:45:21.642ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3352024-09-16T14:45:21.642ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3362024-09-16T14:45:21.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3372024-09-16T14:45:21.643ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3382024-09-16T14:45:21.644ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3392024-09-16T14:45:21.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3402024-09-16T14:45:21.648ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3412024-09-16T14:45:21.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3422024-09-16T14:45:21.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3432024-09-16T14:45:21.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3442024-09-16T14:45:21.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3452024-09-16T14:45:21.653ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3462024-09-16T14:45:21.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3472024-09-16T14:45:21.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 100.508975ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
3482024-09-16T14:45:21.657ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
3492024-09-16T14:45:21.657ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 102.38421ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
3502024-09-16T14:45:21.660ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d70d9c11-14c5-40d0-be17-039af1ae521e dns_zone_name = oxide.test found_so_far = 1 version = 2
3512024-09-16T14:45:21.660ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
3522024-09-16T14:45:21.660ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-16 14:41:24.562175 UTC dns_group = external generation = 2
3532024-09-16T14:45:21.660ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 105.245304ms iteration = 6 status = {"generation":2}
3542024-09-16T14:45:21.666ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 01c7aafc-c1b7-42bb-a493-0c643f2e21db dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
3552024-09-16T14:45:21.666ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3562024-09-16T14:45:21.666ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-16 14:41:23.295040 UTC dns_group = internal generation = 1
3572024-09-16T14:45:21.666ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 111.885091ms iteration = 6 status = {"generation":1}
3582024-09-16T14:45:21.681ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
3592024-09-16T14:45:21.691ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
3602024-09-16T14:45:21.691ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
3612024-09-16T14:45:21.691ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 136.702914ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
3622024-09-16T14:45:21.695ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
3632024-09-16T14:45:21.695ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:226 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3642024-09-16T14:45:21.695ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 140.771702ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3652024-09-16T14:45:21.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 146.847207ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
3662024-09-16T14:45:21.713ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
3672024-09-16T14:45:21.713ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3682024-09-16T14:45:21.713ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2dab7a08-f3d7-4740-b7d0-aa66ed2018f5", "content-length": "26", "date": "Mon, 16 Sep 2024 14:45:20 GMT"} })
3692024-09-16T14:45:21.713ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3702024-09-16T14:45:21.715ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-16T14:41:19.171997Z, time_modified: 2024-09-16T14:41:19.171997Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2f0f2dc2-cb37-4fec-9d0b-492287602073, db_silo: Silo { identity: SiloIdentity { id: 2f0f2dc2-cb37-4fec-9d0b-492287602073, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-16T14:41:24.495850Z, time_modified: 2024-09-16T14:41:24.495850Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7a1e72c489a058dd07f837cad69c701f6b45e7cf21c6d4f626d443caf9673a83" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2f0f2dc2-cb37-4fec-9d0b-492287602073, db_silo: Silo { identity: SiloIdentity { id: 2f0f2dc2-cb37-4fec-9d0b-492287602073, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-16T14:41:24.495850Z, time_modified: 2024-09-16T14:41:24.495850Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7a1e72c489a058dd07f837cad69c701f6b45e7cf21c6d4f626d443caf9673a83" }] }) }
3712024-09-16T14:45:21.715ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 160.823533ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2f0f2dc2-cb37-4fec-9d0b-492287602073","tls_certs":["7a1e72c489a058dd07f837cad69c701f6b45e7cf21c6d4f626d443caf9673a83"]}},"default_endpoint":{"silo_id":"2f0f2dc2-cb37-4fec-9d0b-492287602073","tls_certs":["7a1e72c489a058dd07f837cad69c701f6b45e7cf21c6d4f626d443caf9673a83"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
3722024-09-16T14:45:21.715ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3732024-09-16T14:45:21.718ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3742024-09-16T14:45:21.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3752024-09-16T14:45:21.720ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
3762024-09-16T14:45:21.728ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 173.583446ms iteration = 12 status = {"physical_disks_added":0}
3772024-09-16T14:45:21.737ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3782024-09-16T14:45:21.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3792024-09-16T14:45:21.739ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3802024-09-16T14:45:21.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3812024-09-16T14:45:21.741ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3822024-09-16T14:45:21.741ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
3832024-09-16T14:45:21.741ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3842024-09-16T14:45:21.742ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "47661462-e274-4a1e-9d60-27719245e081", "content-length": "26", "date": "Mon, 16 Sep 2024 14:45:20 GMT"} })
3852024-09-16T14:45:21.742ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3862024-09-16T14:45:21.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f26461d2-04fe-40aa-80c2-1eb0bc461628, lookup_type: ById(f26461d2-04fe-40aa-80c2-1eb0bc461628) } result = Ok(())
3872024-09-16T14:45:21.744ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3882024-09-16T14:45:21.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3892024-09-16T14:45:21.744ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3902024-09-16T14:45:21.751ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 196.143726ms iteration = 9 status = 0
3912024-09-16T14:45:21.767ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3922024-09-16T14:45:21.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3932024-09-16T14:45:21.769ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3942024-09-16T14:45:21.772ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3952024-09-16T14:45:21.772ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3962024-09-16T14:45:21.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3972024-09-16T14:45:21.773ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3982024-09-16T14:45:21.776ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3992024-09-16T14:45:21.776ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4002024-09-16T14:45:21.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4012024-09-16T14:45:21.804ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 zone_address = fd00:1122:3344:101::2
4022024-09-16T14:45:21.804ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4032024-09-16T14:45:21.805ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a6b933bf-23c3-47ed-ab50-67edb27f494f", "content-length": "26", "date": "Mon, 16 Sep 2024 14:45:20 GMT"} })
4042024-09-16T14:45:21.805ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4052024-09-16T14:45:21.806ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
4062024-09-16T14:45:21.878ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4072024-09-16T14:45:21.878ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "49cea1e8-912f-4f8b-8aa8-82b60705a655", "content-length": "372", "date": "Mon, 16 Sep 2024 14:45:21 GMT"} })
4082024-09-16T14:45:21.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4092024-09-16T14:45:21.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4102024-09-16T14:45:21.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4112024-09-16T14:45:21.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4122024-09-16T14:45:21.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4132024-09-16T14:45:21.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4142024-09-16T14:45:21.920ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
4152024-09-16T14:45:21.921ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9800692a-2236-4a73-af58-2aad51462ffc", "date": "Mon, 16 Sep 2024 14:45:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4162024-09-16T14:45:21.921ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4172024-09-16T14:45:21.922ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "27654052-ecaa-4d62-8a5e-60e24b9d6c01", "date": "Mon, 16 Sep 2024 14:45:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4182024-09-16T14:45:21.922ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4192024-09-16T14:45:21.924ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4202024-09-16T14:45:21.924ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 369.197092ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
4212024-09-16T14:45:21.946ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4222024-09-16T14:45:21.946ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4a71ab5c-0fd7-4ead-817b-b724c3ae1317", "content-length": "1", "date": "Mon, 16 Sep 2024 14:45:21 GMT"} })
4232024-09-16T14:45:21.948ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4242024-09-16T14:45:21.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4252024-09-16T14:45:21.950ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
4262024-09-16T14:45:21.952ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
4272024-09-16T14:45:21.953ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d90960bc-12ca-41bd-842a-b121330af1f3", "content-length": "691", "date": "Mon, 16 Sep 2024 14:45:21 GMT"} })
4282024-09-16T14:45:21.953ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
4292024-09-16T14:45:21.953ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
4302024-09-16T14:45:21.953ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
4312024-09-16T14:45:21.954ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 399.309665ms iteration = 9 status = {}
4322024-09-16T14:45:21.954ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 399.617862ms iteration = 9 status = null
4332024-09-16T14:45:21.955ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4342024-09-16T14:45:21.956ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3cc4eef1-5d4d-4e34-9ce3-bbb22711fcab", "date": "Mon, 16 Sep 2024 14:45:21 GMT"} })
4352024-09-16T14:45:21.958ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 403.20507ms iteration = 10 status = {}
4362024-09-16T14:45:22.021ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 467.050226ms iteration = 9 status = {}
4372024-09-16T14:45:22.060ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4382024-09-16T14:45:22.062ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d49910f7-d5f5-4bf7-825e-b7ea15b45356", "date": "Mon, 16 Sep 2024 14:45:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4392024-09-16T14:45:22.062ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4402024-09-16T14:45:22.063ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "81a27d07-396d-4cca-a40d-f13db4cda59d", "date": "Mon, 16 Sep 2024 14:45:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4412024-09-16T14:45:22.063ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4422024-09-16T14:45:22.064ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "36686ac5-b24d-442f-99c9-0f995e759229", "date": "Mon, 16 Sep 2024 14:45:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4432024-09-16T14:45:22.064ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4442024-09-16T14:45:22.066ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4452024-09-16T14:45:22.066ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 511.683097ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4462024-09-16T14:45:22.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4472024-09-16T14:45:22.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4482024-09-16T14:45:22.092ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 94d6770e-63ed-455d-aa9f-8ad47c66c84e, rack_id: 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bc13c6ca-2923-40a0-a45c-bfa5d94842d2) } rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0
4492024-09-16T14:45:22.092ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4502024-09-16T14:45:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4512024-09-16T14:45:22.203ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4522024-09-16T14:45:22.204ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cff53073-f835-411d-8271-0e70f9e82dec", "content-length": "121", "date": "Mon, 16 Sep 2024 14:45:21 GMT"} })
4532024-09-16T14:45:22.204ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
4542024-09-16T14:45:22.204ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bc13c6ca-2923-40a0-a45c-bfa5d94842d2
4552024-09-16T14:45:22.204ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4562024-09-16T14:45:22.204ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4572024-09-16T14:45:22.204ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {}
4582024-09-16T14:45:22.204ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {}
4592024-09-16T14:45:22.204ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
4602024-09-16T14:45:22.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4612024-09-16T14:45:22.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4622024-09-16T14:45:22.206ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
4632024-09-16T14:45:22.206ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d941e1b7-58bb-4beb-b39e-c0a3867f38be", "content-length": "2", "date": "Mon, 16 Sep 2024 14:45:21 GMT"} })
4642024-09-16T14:45:22.206ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
4652024-09-16T14:45:22.206ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5160ed08-a1e5-4403-9347-68bf41861497", "content-length": "52", "date": "Mon, 16 Sep 2024 14:45:21 GMT"} })
4662024-09-16T14:45:22.206ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0
4672024-09-16T14:45:22.206ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
4682024-09-16T14:45:22.355ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6c0717b7-6c82-4755-bf22-b63398f2398a", "date": "Mon, 16 Sep 2024 14:45:22 GMT"} })
4692024-09-16T14:45:22.355ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch = Switch0
4702024-09-16T14:45:22.355ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
4712024-09-16T14:45:22.355ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bc776780-487a-412a-a30a-8c03776e9749", "content-length": "667", "date": "Mon, 16 Sep 2024 14:45:22 GMT"} })
4722024-09-16T14:45:22.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4732024-09-16T14:45:22.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4742024-09-16T14:45:22.359ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4752024-09-16T14:45:22.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4762024-09-16T14:45:22.363ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4772024-09-16T14:45:22.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4782024-09-16T14:45:22.365ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4792024-09-16T14:45:22.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4802024-09-16T14:45:22.371ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 816.707426ms iteration = 9 status = {}
4812024-09-16T14:45:22.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8e61601e-8d32-4cd1-9fb2-bb19428c4dfe roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
4822024-09-16T14:45:22.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8e61601e-8d32-4cd1-9fb2-bb19428c4dfe resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
4832024-09-16T14:45:22.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8e61601e-8d32-4cd1-9fb2-bb19428c4dfe response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
4842024-09-16T14:45:23.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 069d31a3-0d38-44f1-8ee0-5ad0c9c497d9 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
4852024-09-16T14:45:23.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 069d31a3-0d38-44f1-8ee0-5ad0c9c497d9 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
4862024-09-16T14:45:23.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1623 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 069d31a3-0d38-44f1-8ee0-5ad0c9c497d9 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
4872024-09-16T14:45:24.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c83151c5-cb10-4f59-a6a4-8cf61783b3c5 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
4882024-09-16T14:45:24.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c83151c5-cb10-4f59-a6a4-8cf61783b3c5 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
4892024-09-16T14:45:24.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c83151c5-cb10-4f59-a6a4-8cf61783b3c5 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
4902024-09-16T14:45:25.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 70c2f9f5-45f5-48f7-9dbb-14079228eaa2 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
4912024-09-16T14:45:25.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 70c2f9f5-45f5-48f7-9dbb-14079228eaa2 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
4922024-09-16T14:45:25.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1839 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 70c2f9f5-45f5-48f7-9dbb-14079228eaa2 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
4932024-09-16T14:45:25.735ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1186 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = 3ce81a2a-7dc7-4d86-8a79-31fef5463953 response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
4942024-09-16T14:45:26.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 86a30f23-f71b-4b88-8243-7d834236f06b roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
4952024-09-16T14:45:26.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 86a30f23-f71b-4b88-8243-7d834236f06b resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
4962024-09-16T14:45:26.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 86a30f23-f71b-4b88-8243-7d834236f06b response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
4972024-09-16T14:45:27.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 58576a4a-a277-4418-8894-9258109ef4eb roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
4982024-09-16T14:45:27.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 58576a4a-a277-4418-8894-9258109ef4eb resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
4992024-09-16T14:45:27.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 58576a4a-a277-4418-8894-9258109ef4eb response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5002024-09-16T14:45:28.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7671fe5e-26c5-4244-8347-45f554184120 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5012024-09-16T14:45:28.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7671fe5e-26c5-4244-8347-45f554184120 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5022024-09-16T14:45:28.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7671fe5e-26c5-4244-8347-45f554184120 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5032024-09-16T14:45:29.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = b3370362-df11-4cd1-a04a-f508d2c8ea5a roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5042024-09-16T14:45:29.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = b3370362-df11-4cd1-a04a-f508d2c8ea5a resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5052024-09-16T14:45:29.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = b3370362-df11-4cd1-a04a-f508d2c8ea5a response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5062024-09-16T14:45:30.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5fe7d962-8bda-4d6d-a062-8646ac2a7581 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5072024-09-16T14:45:30.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5fe7d962-8bda-4d6d-a062-8646ac2a7581 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5082024-09-16T14:45:30.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5fe7d962-8bda-4d6d-a062-8646ac2a7581 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5092024-09-16T14:45:31.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
5102024-09-16T14:45:31.555ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
5112024-09-16T14:45:31.555ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5122024-09-16T14:45:31.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5132024-09-16T14:45:31.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5142024-09-16T14:45:31.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5152024-09-16T14:45:31.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5162024-09-16T14:45:31.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5172024-09-16T14:45:31.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5182024-09-16T14:45:31.558ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.717241ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5192024-09-16T14:45:31.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5202024-09-16T14:45:31.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5212024-09-16T14:45:31.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5222024-09-16T14:45:31.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5232024-09-16T14:45:31.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5242024-09-16T14:45:31.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5252024-09-16T14:45:31.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
5262024-09-16T14:45:31.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5272024-09-16T14:45:31.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5282024-09-16T14:45:31.572ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
5292024-09-16T14:45:31.572ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.273489ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
5302024-09-16T14:45:31.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d2c1450b-35d5-4569-a966-785c39053f94 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5312024-09-16T14:45:31.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d2c1450b-35d5-4569-a966-785c39053f94 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5322024-09-16T14:45:31.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d2c1450b-35d5-4569-a966-785c39053f94 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5332024-09-16T14:45:32.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7d96004c-8847-4f6c-bfa6-dfd780eb31c3 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5342024-09-16T14:45:32.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7d96004c-8847-4f6c-bfa6-dfd780eb31c3 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5352024-09-16T14:45:32.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1760 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7d96004c-8847-4f6c-bfa6-dfd780eb31c3 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5362024-09-16T14:45:33.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 71757891-9650-46bd-99dd-034ea21ae511 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5372024-09-16T14:45:33.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 71757891-9650-46bd-99dd-034ea21ae511 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5382024-09-16T14:45:33.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 71757891-9650-46bd-99dd-034ea21ae511 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5392024-09-16T14:45:34.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 0faa7e53-15bd-436e-8030-0490363aba2d roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5402024-09-16T14:45:34.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 0faa7e53-15bd-436e-8030-0490363aba2d resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5412024-09-16T14:45:34.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 0faa7e53-15bd-436e-8030-0490363aba2d response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5422024-09-16T14:45:35.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 504e6a06-f60b-4bad-82bf-442714572ee1 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5432024-09-16T14:45:35.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 504e6a06-f60b-4bad-82bf-442714572ee1 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5442024-09-16T14:45:35.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1783 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 504e6a06-f60b-4bad-82bf-442714572ee1 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5452024-09-16T14:45:35.736ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1220 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = ae87da24-ccfe-4e68-a554-a4c452de69ca response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
5462024-09-16T14:45:36.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4ca2aa2f-0a5c-41e6-b605-b4386ca7a002 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5472024-09-16T14:45:36.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4ca2aa2f-0a5c-41e6-b605-b4386ca7a002 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5482024-09-16T14:45:36.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4ca2aa2f-0a5c-41e6-b605-b4386ca7a002 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5492024-09-16T14:45:37.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c32585d9-be85-453f-9f6e-22e9df45b7d0 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5502024-09-16T14:45:37.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c32585d9-be85-453f-9f6e-22e9df45b7d0 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5512024-09-16T14:45:37.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c32585d9-be85-453f-9f6e-22e9df45b7d0 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5522024-09-16T14:45:38.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d876cb11-91c0-4932-a20e-41872c6f0b47 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5532024-09-16T14:45:38.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d876cb11-91c0-4932-a20e-41872c6f0b47 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5542024-09-16T14:45:38.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d876cb11-91c0-4932-a20e-41872c6f0b47 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5552024-09-16T14:45:39.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 34dfe7de-0ee4-4165-9347-e997bbcd52bc roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5562024-09-16T14:45:39.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 34dfe7de-0ee4-4165-9347-e997bbcd52bc resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5572024-09-16T14:45:39.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 34dfe7de-0ee4-4165-9347-e997bbcd52bc response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5582024-09-16T14:45:40.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7d36cd11-a0ad-4126-8e04-765a165ac5e4 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5592024-09-16T14:45:40.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7d36cd11-a0ad-4126-8e04-765a165ac5e4 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5602024-09-16T14:45:40.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7d36cd11-a0ad-4126-8e04-765a165ac5e4 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5612024-09-16T14:45:41.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
5622024-09-16T14:45:41.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5632024-09-16T14:45:41.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
5642024-09-16T14:45:41.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5652024-09-16T14:45:41.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5662024-09-16T14:45:41.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5672024-09-16T14:45:41.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5682024-09-16T14:45:41.556ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5692024-09-16T14:45:41.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5702024-09-16T14:45:41.558ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.417276ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5712024-09-16T14:45:41.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5722024-09-16T14:45:41.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5732024-09-16T14:45:41.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5742024-09-16T14:45:41.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5752024-09-16T14:45:41.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5762024-09-16T14:45:41.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5772024-09-16T14:45:41.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
5782024-09-16T14:45:41.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5792024-09-16T14:45:41.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5802024-09-16T14:45:41.569ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
5812024-09-16T14:45:41.569ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.23074ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
5822024-09-16T14:45:41.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6f639367-ff3c-484d-8a6a-5328454aa79e roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5832024-09-16T14:45:41.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6f639367-ff3c-484d-8a6a-5328454aa79e resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5842024-09-16T14:45:41.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2471 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6f639367-ff3c-484d-8a6a-5328454aa79e response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5852024-09-16T14:45:42.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3bdaa179-dae1-43b0-96d3-9b0de2b4a974 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5862024-09-16T14:45:42.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3bdaa179-dae1-43b0-96d3-9b0de2b4a974 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5872024-09-16T14:45:42.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3bdaa179-dae1-43b0-96d3-9b0de2b4a974 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5882024-09-16T14:45:43.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = cf3c1a32-3f35-488d-9f47-0e5e349e4f56 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5892024-09-16T14:45:43.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = cf3c1a32-3f35-488d-9f47-0e5e349e4f56 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5902024-09-16T14:45:43.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = cf3c1a32-3f35-488d-9f47-0e5e349e4f56 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5912024-09-16T14:45:44.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5359702b-f1d4-4a4b-bd3b-7733ecea9d71 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5922024-09-16T14:45:44.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5359702b-f1d4-4a4b-bd3b-7733ecea9d71 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5932024-09-16T14:45:44.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5359702b-f1d4-4a4b-bd3b-7733ecea9d71 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5942024-09-16T14:45:45.736ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1610 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = 8b193553-2cba-4c5d-a1a0-3fad79b0f11a response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
5952024-09-16T14:45:45.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 594abb64-8f57-4ff4-af0d-5e25f57d035e roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5962024-09-16T14:45:45.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 594abb64-8f57-4ff4-af0d-5e25f57d035e resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5972024-09-16T14:45:45.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2522 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 594abb64-8f57-4ff4-af0d-5e25f57d035e response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5982024-09-16T14:45:46.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 126c53ae-9007-431c-9ec8-b8cd5204aeec roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
5992024-09-16T14:45:46.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 126c53ae-9007-431c-9ec8-b8cd5204aeec resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
6002024-09-16T14:45:46.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 126c53ae-9007-431c-9ec8-b8cd5204aeec response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
6012024-09-16T14:45:47.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f8b1af81-dd51-4b49-ab0e-ce83214898c2 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
6022024-09-16T14:45:47.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f8b1af81-dd51-4b49-ab0e-ce83214898c2 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
6032024-09-16T14:45:47.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1999 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f8b1af81-dd51-4b49-ab0e-ce83214898c2 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
6042024-09-16T14:45:49.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 2c7eed1f-6163-4cf1-bb44-375b69180300 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
6052024-09-16T14:45:49.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 2c7eed1f-6163-4cf1-bb44-375b69180300 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
6062024-09-16T14:45:49.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 2c7eed1f-6163-4cf1-bb44-375b69180300 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
6072024-09-16T14:45:50.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e6ee7f51-c5fd-405e-ad4d-d327f46dd10d roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
6082024-09-16T14:45:50.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e6ee7f51-c5fd-405e-ad4d-d327f46dd10d resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
6092024-09-16T14:45:50.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e6ee7f51-c5fd-405e-ad4d-d327f46dd10d response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
6102024-09-16T14:45:51.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = bc8de42a-7f00-483c-8a77-4c832bf2f668 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
6112024-09-16T14:45:51.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = bc8de42a-7f00-483c-8a77-4c832bf2f668 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
6122024-09-16T14:45:51.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = bc8de42a-7f00-483c-8a77-4c832bf2f668 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
6132024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
6142024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
6152024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6162024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
6172024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6182024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6192024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
6202024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6212024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
6222024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
6232024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6242024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6252024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
6262024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6272024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
6282024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
6292024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6302024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
6312024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
6322024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
6332024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
6342024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6352024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
6362024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
6372024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6382024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
6392024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6402024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
6412024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6422024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
6432024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6442024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
6452024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
6462024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6472024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
6482024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6492024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6502024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6512024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6522024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
6532024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
6542024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6552024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6562024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6572024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6582024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6592024-09-16T14:45:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6602024-09-16T14:45:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6612024-09-16T14:45:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6622024-09-16T14:45:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6632024-09-16T14:45:51.555ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 1.56821ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6642024-09-16T14:45:51.557ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24040, tv_nsec: 516026783 } })
6652024-09-16T14:45:51.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6662024-09-16T14:45:51.557ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
6672024-09-16T14:45:51.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6682024-09-16T14:45:51.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6692024-09-16T14:45:51.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6702024-09-16T14:45:51.558ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.297592ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
6712024-09-16T14:45:51.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6722024-09-16T14:45:51.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6732024-09-16T14:45:51.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6742024-09-16T14:45:51.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6752024-09-16T14:45:51.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6762024-09-16T14:45:51.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6772024-09-16T14:45:51.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6782024-09-16T14:45:51.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6792024-09-16T14:45:51.561ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.739728ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
6802024-09-16T14:45:51.562ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6812024-09-16T14:45:51.563ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6822024-09-16T14:45:51.563ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6832024-09-16T14:45:51.564ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24040, tv_nsec: 522733570 } })
6842024-09-16T14:45:51.564ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6852024-09-16T14:45:51.564ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
6862024-09-16T14:45:51.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6872024-09-16T14:45:51.565ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6882024-09-16T14:45:51.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6892024-09-16T14:45:51.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6902024-09-16T14:45:51.566ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6912024-09-16T14:45:51.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6922024-09-16T14:45:51.566ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6932024-09-16T14:45:51.566ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6942024-09-16T14:45:51.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6952024-09-16T14:45:51.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
6962024-09-16T14:45:51.567ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6972024-09-16T14:45:51.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6982024-09-16T14:45:51.568ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.879024ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6992024-09-16T14:45:51.568ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
7002024-09-16T14:45:51.568ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
7012024-09-16T14:45:51.568ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7022024-09-16T14:45:51.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7032024-09-16T14:45:51.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7042024-09-16T14:45:51.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7052024-09-16T14:45:51.570ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7062024-09-16T14:45:51.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7072024-09-16T14:45:51.570ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7082024-09-16T14:45:51.571ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7092024-09-16T14:45:51.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7102024-09-16T14:45:51.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7112024-09-16T14:45:51.572ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24040, tv_nsec: 530983917 } })
7122024-09-16T14:45:51.572ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
7132024-09-16T14:45:51.573ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7142024-09-16T14:45:51.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7152024-09-16T14:45:51.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7162024-09-16T14:45:51.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
7172024-09-16T14:45:51.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7182024-09-16T14:45:51.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7192024-09-16T14:45:51.575ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7202024-09-16T14:45:51.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7212024-09-16T14:45:51.577ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7222024-09-16T14:45:51.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7232024-09-16T14:45:51.588ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
7242024-09-16T14:45:51.588ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 34.198902ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
7252024-09-16T14:45:51.592ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 37.866391ms iteration = 13 status = {"physical_disks_added":0}
7262024-09-16T14:45:51.593ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7272024-09-16T14:45:51.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7282024-09-16T14:45:51.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7292024-09-16T14:45:51.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7302024-09-16T14:45:51.595ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 40.719166ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
7312024-09-16T14:45:51.596ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7322024-09-16T14:45:51.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7332024-09-16T14:45:51.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7342024-09-16T14:45:51.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7352024-09-16T14:45:51.603ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 49.546344ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
7362024-09-16T14:45:51.608ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
7372024-09-16T14:45:51.608ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7382024-09-16T14:45:51.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7392024-09-16T14:45:51.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7402024-09-16T14:45:51.616ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:539 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7412024-09-16T14:45:51.616ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.822718ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7422024-09-16T14:45:51.682ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7432024-09-16T14:45:51.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7442024-09-16T14:45:51.684ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
7452024-09-16T14:45:51.684ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7462024-09-16T14:45:51.685ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "85e1f45a-84e4-43eb-9ea4-6a01d9e8d00e", "content-length": "26", "date": "Mon, 16 Sep 2024 14:45:50 GMT"} })
7472024-09-16T14:45:51.685ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7482024-09-16T14:45:51.687ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7492024-09-16T14:45:51.691ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 zone_address = fd00:1122:3344:101::2
7502024-09-16T14:45:51.691ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7512024-09-16T14:45:51.691ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "30338e6c-2a3b-442b-9b45-6e03b6b2d9e3", "content-length": "26", "date": "Mon, 16 Sep 2024 14:45:50 GMT"} })
7522024-09-16T14:45:51.691ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7532024-09-16T14:45:51.693ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
7542024-09-16T14:45:51.745ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
7552024-09-16T14:45:51.745ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7562024-09-16T14:45:51.746ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9ea1395a-8303-4335-bef7-91c5ead5707e", "content-length": "26", "date": "Mon, 16 Sep 2024 14:45:50 GMT"} })
7572024-09-16T14:45:51.746ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7582024-09-16T14:45:51.747ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7592024-09-16T14:45:51.774ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7602024-09-16T14:45:51.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7612024-09-16T14:45:51.780ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f26461d2-04fe-40aa-80c2-1eb0bc461628, lookup_type: ById(f26461d2-04fe-40aa-80c2-1eb0bc461628) } result = Ok(())
7622024-09-16T14:45:51.780ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7632024-09-16T14:45:51.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7642024-09-16T14:45:51.782ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 228.039183ms iteration = 10 status = 0
7652024-09-16T14:45:51.787ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7662024-09-16T14:45:51.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7672024-09-16T14:45:51.789ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7682024-09-16T14:45:51.791ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7692024-09-16T14:45:51.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7702024-09-16T14:45:51.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7712024-09-16T14:45:51.792ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7722024-09-16T14:45:51.794ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7732024-09-16T14:45:51.794ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7742024-09-16T14:45:51.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7752024-09-16T14:45:51.796ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7762024-09-16T14:45:51.797ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c818037f-c5ca-4acb-880e-4a8c059d7c76", "content-length": "1", "date": "Mon, 16 Sep 2024 14:45:51 GMT"} })
7772024-09-16T14:45:51.799ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7782024-09-16T14:45:51.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7792024-09-16T14:45:51.801ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 246.73972ms iteration = 10 status = null
7802024-09-16T14:45:51.804ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
7812024-09-16T14:45:51.804ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:226 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7822024-09-16T14:45:51.804ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 249.743457ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7832024-09-16T14:45:51.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7842024-09-16T14:45:51.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7852024-09-16T14:45:51.827ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 272.9744ms iteration = 10 status = {}
7862024-09-16T14:45:51.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 280.565034ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
7872024-09-16T14:45:51.836ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1b879778-7545-4961-92d0-77af680768fa", "content-length": "372", "date": "Mon, 16 Sep 2024 14:45:51 GMT"} })
7882024-09-16T14:45:51.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7892024-09-16T14:45:51.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7902024-09-16T14:45:51.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7912024-09-16T14:45:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7922024-09-16T14:45:51.864ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7932024-09-16T14:45:51.864ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1bedd11c-a79d-46e4-a8f8-5d8004bef10c", "content-length": "691", "date": "Mon, 16 Sep 2024 14:45:51 GMT"} })
7942024-09-16T14:45:51.864ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
7952024-09-16T14:45:51.864ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
7962024-09-16T14:45:51.864ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
7972024-09-16T14:45:51.865ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 311.359871ms iteration = 10 status = {}
7982024-09-16T14:45:51.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7992024-09-16T14:45:51.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8002024-09-16T14:45:51.870ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8012024-09-16T14:45:51.871ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c45fb733-9170-4cda-9f04-b957d6273eca", "date": "Mon, 16 Sep 2024 14:45:51 GMT"} })
8022024-09-16T14:45:51.872ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 318.498207ms iteration = 11 status = {}
8032024-09-16T14:45:51.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8042024-09-16T14:45:51.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8052024-09-16T14:45:51.895ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 94d6770e-63ed-455d-aa9f-8ad47c66c84e, rack_id: 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bc13c6ca-2923-40a0-a45c-bfa5d94842d2) } rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0
8062024-09-16T14:45:51.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8072024-09-16T14:45:51.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8082024-09-16T14:45:51.903ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8092024-09-16T14:45:51.903ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4e226c33-0499-48e7-91b3-fff722b9c806", "content-length": "121", "date": "Mon, 16 Sep 2024 14:45:51 GMT"} })
8102024-09-16T14:45:51.903ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
8112024-09-16T14:45:51.903ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bc13c6ca-2923-40a0-a45c-bfa5d94842d2
8122024-09-16T14:45:51.904ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8132024-09-16T14:45:51.904ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8142024-09-16T14:45:51.904ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {}
8152024-09-16T14:45:51.904ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {}
8162024-09-16T14:45:51.904ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
8172024-09-16T14:45:51.904ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8182024-09-16T14:45:51.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8192024-09-16T14:45:51.906ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8202024-09-16T14:45:51.906ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6b8b2b3f-bec5-40d3-8032-6753f9c5ea9a", "content-length": "2", "date": "Mon, 16 Sep 2024 14:45:51 GMT"} })
8212024-09-16T14:45:51.906ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8222024-09-16T14:45:51.906ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "105d05c4-29f8-41c5-9cfe-ba6840f85a18", "content-length": "52", "date": "Mon, 16 Sep 2024 14:45:51 GMT"} })
8232024-09-16T14:45:51.906ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0
8242024-09-16T14:45:51.906ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8252024-09-16T14:45:52.001ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "fd0e1c1a-0482-4317-a6b9-7ca8694b4898", "date": "Mon, 16 Sep 2024 14:45:51 GMT"} })
8262024-09-16T14:45:52.001ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch = Switch0
8272024-09-16T14:45:52.001ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8282024-09-16T14:45:52.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 86e393eb-19f1-40fe-b14e-d93b860b9812 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8292024-09-16T14:45:52.092ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a0e37278-8af8-4abf-a127-cecd4ae66a76", "content-length": "667", "date": "Mon, 16 Sep 2024 14:45:51 GMT"} })
8302024-09-16T14:45:52.092ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8312024-09-16T14:45:52.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 86e393eb-19f1-40fe-b14e-d93b860b9812 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8322024-09-16T14:45:52.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8332024-09-16T14:45:52.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 86e393eb-19f1-40fe-b14e-d93b860b9812 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8342024-09-16T14:45:52.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8352024-09-16T14:45:52.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8362024-09-16T14:45:52.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8372024-09-16T14:45:52.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8382024-09-16T14:45:52.103ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8392024-09-16T14:45:52.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8402024-09-16T14:45:52.109ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 555.048853ms iteration = 10 status = {}
8412024-09-16T14:45:53.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e92f2d63-1797-44d3-a43f-b3c53c9641b0 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8422024-09-16T14:45:53.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e92f2d63-1797-44d3-a43f-b3c53c9641b0 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8432024-09-16T14:45:53.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e92f2d63-1797-44d3-a43f-b3c53c9641b0 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8442024-09-16T14:45:54.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 34da6507-280b-4206-b422-0bb6c0c7d850 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8452024-09-16T14:45:54.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 34da6507-280b-4206-b422-0bb6c0c7d850 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8462024-09-16T14:45:54.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2868 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 34da6507-280b-4206-b422-0bb6c0c7d850 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8472024-09-16T14:45:55.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = bd79c5d8-9ffc-4d01-bb2e-7db44d63d393 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8482024-09-16T14:45:55.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = bd79c5d8-9ffc-4d01-bb2e-7db44d63d393 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8492024-09-16T14:45:55.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = bd79c5d8-9ffc-4d01-bb2e-7db44d63d393 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8502024-09-16T14:45:55.735ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1208 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = 3ef1bfcd-8342-4a19-b186-d5f49e16d29f response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
8512024-09-16T14:45:56.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 696da8c3-0b0c-43c6-9cb7-a06553273f54 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8522024-09-16T14:45:56.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 696da8c3-0b0c-43c6-9cb7-a06553273f54 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8532024-09-16T14:45:56.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 696da8c3-0b0c-43c6-9cb7-a06553273f54 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8542024-09-16T14:45:57.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 48289b76-429c-484a-9b0a-1016bc7cc8d4 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8552024-09-16T14:45:57.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 48289b76-429c-484a-9b0a-1016bc7cc8d4 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8562024-09-16T14:45:57.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1944 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 48289b76-429c-484a-9b0a-1016bc7cc8d4 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8572024-09-16T14:45:58.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 9b263708-c570-4d41-aa1f-ef84a1f40a35 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8582024-09-16T14:45:58.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 9b263708-c570-4d41-aa1f-ef84a1f40a35 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8592024-09-16T14:45:58.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 9b263708-c570-4d41-aa1f-ef84a1f40a35 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8602024-09-16T14:45:59.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = af8f3a0a-0f65-42cf-9d43-2bcfffa6a5c3 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8612024-09-16T14:45:59.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = af8f3a0a-0f65-42cf-9d43-2bcfffa6a5c3 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8622024-09-16T14:45:59.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = af8f3a0a-0f65-42cf-9d43-2bcfffa6a5c3 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8632024-09-16T14:46:00.269ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:54008
8642024-09-16T14:46:00.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:54008 req_id = 43c761a6-ff8d-4e76-9cf1-8c9c2511892f roles = RoleSet { roles: {} } uri = /metrics/producers
8652024-09-16T14:46:00.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:54008 req_id = 43c761a6-ff8d-4e76-9cf1-8c9c2511892f resource = Database result = Ok(()) uri = /metrics/producers
8662024-09-16T14:46:00.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a0cf2765-bc00-42b3-a1f3-1b4e443c41b2 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8672024-09-16T14:46:00.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a0cf2765-bc00-42b3-a1f3-1b4e443c41b2 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8682024-09-16T14:46:00.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1854 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a0cf2765-bc00-42b3-a1f3-1b4e443c41b2 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8692024-09-16T14:46:00.302ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d9cae32d-8e84-4f97-9d87-f815a97563b7
8702024-09-16T14:46:00.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:54008 req_id = 43c761a6-ff8d-4e76-9cf1-8c9c2511892f roles = RoleSet { roles: {} } uri = /metrics/producers
8712024-09-16T14:46:00.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:54008 req_id = 43c761a6-ff8d-4e76-9cf1-8c9c2511892f resource = Database result = Ok(()) uri = /metrics/producers
8722024-09-16T14:46:00.336ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 uri = http://[fd00:1122:3344:101::d]:12223/producers
8732024-09-16T14:46:00.336ZDEBGnexus: client response oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c72b67d4-3e96-44ec-ad68-2d60f4e0d3a8", "date": "Mon, 16 Sep 2024 14:46:00 GMT"} })
8742024-09-16T14:46:00.336ZINFOnexus: assigned collector to new producer collector_id = d9cae32d-8e84-4f97-9d87-f815a97563b7 file = nexus/src/app/oximeter.rs:125 producer_id = f26461d2-04fe-40aa-80c2-1eb0bc461628
8752024-09-16T14:46:00.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 69554 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:54008 req_id = 43c761a6-ff8d-4e76-9cf1-8c9c2511892f response_code = 201 uri = /metrics/producers
8762024-09-16T14:46:01.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c558766d-0453-4e3c-a21a-beee009943a5 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8772024-09-16T14:46:01.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c558766d-0453-4e3c-a21a-beee009943a5 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8782024-09-16T14:46:01.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c558766d-0453-4e3c-a21a-beee009943a5 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
8792024-09-16T14:46:01.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
8802024-09-16T14:46:01.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
8812024-09-16T14:46:01.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8822024-09-16T14:46:01.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8832024-09-16T14:46:01.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8842024-09-16T14:46:01.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8852024-09-16T14:46:01.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8862024-09-16T14:46:01.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8872024-09-16T14:46:01.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8882024-09-16T14:46:01.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8892024-09-16T14:46:01.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8902024-09-16T14:46:01.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8912024-09-16T14:46:01.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8922024-09-16T14:46:01.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
8932024-09-16T14:46:01.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8942024-09-16T14:46:01.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8952024-09-16T14:46:01.572ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
8962024-09-16T14:46:01.572ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.87716ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
8972024-09-16T14:46:01.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8982024-09-16T14:46:01.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8992024-09-16T14:46:01.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.77654ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9002024-09-16T14:46:02.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 1cb1e0e4-c184-43ef-8a49-da9a859f460f roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9012024-09-16T14:46:02.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 1cb1e0e4-c184-43ef-8a49-da9a859f460f resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9022024-09-16T14:46:02.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 1cb1e0e4-c184-43ef-8a49-da9a859f460f response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9032024-09-16T14:46:03.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 43adb67c-e247-4a6b-8680-c6ece658f808 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9042024-09-16T14:46:03.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 43adb67c-e247-4a6b-8680-c6ece658f808 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9052024-09-16T14:46:03.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 43adb67c-e247-4a6b-8680-c6ece658f808 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9062024-09-16T14:46:04.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 388dc5df-de25-4fca-99f9-69d97c7d3fed roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9072024-09-16T14:46:04.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 388dc5df-de25-4fca-99f9-69d97c7d3fed resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9082024-09-16T14:46:04.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1718 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 388dc5df-de25-4fca-99f9-69d97c7d3fed response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9092024-09-16T14:46:05.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e7fffa03-99ee-47be-9545-8b3381249302 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9102024-09-16T14:46:05.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e7fffa03-99ee-47be-9545-8b3381249302 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9112024-09-16T14:46:05.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e7fffa03-99ee-47be-9545-8b3381249302 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9122024-09-16T14:46:05.736ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1285 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = 036b4846-d90a-476c-840d-a025892f19cb response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
9132024-09-16T14:46:06.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 13ae9f21-9e58-4afb-84c5-89f72a684c86 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9142024-09-16T14:46:06.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 13ae9f21-9e58-4afb-84c5-89f72a684c86 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9152024-09-16T14:46:06.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 13ae9f21-9e58-4afb-84c5-89f72a684c86 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9162024-09-16T14:46:07.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c96de041-d319-4827-9ce2-fbc01b0bfc5e roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9172024-09-16T14:46:07.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c96de041-d319-4827-9ce2-fbc01b0bfc5e resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9182024-09-16T14:46:07.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c96de041-d319-4827-9ce2-fbc01b0bfc5e response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9192024-09-16T14:46:08.438ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:50514
9202024-09-16T14:46:08.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50514 req_id = 04b0786a-5cfd-499a-93ed-127e9c3844f2 roles = RoleSet { roles: {} } uri = /metrics/producers
9212024-09-16T14:46:08.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50514 req_id = 04b0786a-5cfd-499a-93ed-127e9c3844f2 resource = Database result = Ok(()) uri = /metrics/producers
9222024-09-16T14:46:08.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = dade236d-dae7-4181-801f-b1766f91241a roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9232024-09-16T14:46:08.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = dade236d-dae7-4181-801f-b1766f91241a resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9242024-09-16T14:46:08.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = dade236d-dae7-4181-801f-b1766f91241a response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9252024-09-16T14:46:08.472ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d9cae32d-8e84-4f97-9d87-f815a97563b7
9262024-09-16T14:46:08.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50514 req_id = 04b0786a-5cfd-499a-93ed-127e9c3844f2 roles = RoleSet { roles: {} } uri = /metrics/producers
9272024-09-16T14:46:08.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50514 req_id = 04b0786a-5cfd-499a-93ed-127e9c3844f2 resource = Database result = Ok(()) uri = /metrics/producers
9282024-09-16T14:46:08.506ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 uri = http://[fd00:1122:3344:101::d]:12223/producers
9292024-09-16T14:46:08.507ZDEBGnexus: client response oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "73b580ae-f053-4cc3-9e0c-c54d98d7f9a9", "date": "Mon, 16 Sep 2024 14:46:08 GMT"} })
9302024-09-16T14:46:08.507ZINFOnexus: assigned collector to new producer collector_id = d9cae32d-8e84-4f97-9d87-f815a97563b7 file = nexus/src/app/oximeter.rs:125 producer_id = 3a79bcd7-ea65-43ad-adb5-6672a26d233e
9312024-09-16T14:46:08.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 70994 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50514 req_id = 04b0786a-5cfd-499a-93ed-127e9c3844f2 response_code = 201 uri = /metrics/producers
9322024-09-16T14:46:09.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 38cce6ae-203b-412c-ae24-f36f513b17df roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9332024-09-16T14:46:09.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 38cce6ae-203b-412c-ae24-f36f513b17df resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9342024-09-16T14:46:09.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 38cce6ae-203b-412c-ae24-f36f513b17df response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9352024-09-16T14:46:10.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d227b42e-f0f3-47a6-b623-2a782380bf81 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9362024-09-16T14:46:10.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d227b42e-f0f3-47a6-b623-2a782380bf81 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9372024-09-16T14:46:10.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1895 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d227b42e-f0f3-47a6-b623-2a782380bf81 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9382024-09-16T14:46:11.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = fbc2d05b-41a9-429b-a353-cfefc472ba2f roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9392024-09-16T14:46:11.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = fbc2d05b-41a9-429b-a353-cfefc472ba2f resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9402024-09-16T14:46:11.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = fbc2d05b-41a9-429b-a353-cfefc472ba2f response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9412024-09-16T14:46:11.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
9422024-09-16T14:46:11.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
9432024-09-16T14:46:11.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9442024-09-16T14:46:11.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9452024-09-16T14:46:11.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9462024-09-16T14:46:11.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9472024-09-16T14:46:11.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9482024-09-16T14:46:11.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9492024-09-16T14:46:11.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9502024-09-16T14:46:11.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9512024-09-16T14:46:11.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9522024-09-16T14:46:11.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9532024-09-16T14:46:11.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9542024-09-16T14:46:11.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
9552024-09-16T14:46:11.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9562024-09-16T14:46:11.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9572024-09-16T14:46:11.573ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
9582024-09-16T14:46:11.574ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.183045ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
9592024-09-16T14:46:11.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9602024-09-16T14:46:11.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9612024-09-16T14:46:11.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.390638ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9622024-09-16T14:46:12.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 68791a97-35d4-47b3-aca3-e002b9466ec4 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9632024-09-16T14:46:12.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 68791a97-35d4-47b3-aca3-e002b9466ec4 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9642024-09-16T14:46:12.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1972 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 68791a97-35d4-47b3-aca3-e002b9466ec4 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9652024-09-16T14:46:13.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 77d81567-c895-4efe-9737-e0dd33425b09 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9662024-09-16T14:46:13.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 77d81567-c895-4efe-9737-e0dd33425b09 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9672024-09-16T14:46:13.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1864 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 77d81567-c895-4efe-9737-e0dd33425b09 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9682024-09-16T14:46:14.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7468ad20-89a3-409a-9855-28485c0daead roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9692024-09-16T14:46:14.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7468ad20-89a3-409a-9855-28485c0daead resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9702024-09-16T14:46:14.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2867 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7468ad20-89a3-409a-9855-28485c0daead response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9712024-09-16T14:46:15.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 93748f3d-95fc-4181-b093-31e672c3b94c roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9722024-09-16T14:46:15.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 93748f3d-95fc-4181-b093-31e672c3b94c resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9732024-09-16T14:46:15.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 93748f3d-95fc-4181-b093-31e672c3b94c response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9742024-09-16T14:46:15.735ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1202 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = 3aa5cc0c-3b4b-4f79-b114-ef881d849f21 response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
9752024-09-16T14:46:16.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 41788862-0642-4ad7-a7f8-c8a8b3dc1d55 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9762024-09-16T14:46:16.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 41788862-0642-4ad7-a7f8-c8a8b3dc1d55 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9772024-09-16T14:46:16.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 41788862-0642-4ad7-a7f8-c8a8b3dc1d55 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9782024-09-16T14:46:17.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = cd835fbf-dc6e-45a8-b2c9-f79fa3656d01 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9792024-09-16T14:46:17.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = cd835fbf-dc6e-45a8-b2c9-f79fa3656d01 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9802024-09-16T14:46:17.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = cd835fbf-dc6e-45a8-b2c9-f79fa3656d01 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9812024-09-16T14:46:18.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 068710f5-3540-4b07-b66d-bf58c81f4264 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9822024-09-16T14:46:18.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 068710f5-3540-4b07-b66d-bf58c81f4264 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9832024-09-16T14:46:18.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 068710f5-3540-4b07-b66d-bf58c81f4264 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9842024-09-16T14:46:19.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 02fb5980-9d67-4dd1-8ab9-646af9a2d722 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9852024-09-16T14:46:19.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 02fb5980-9d67-4dd1-8ab9-646af9a2d722 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9862024-09-16T14:46:19.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 02fb5980-9d67-4dd1-8ab9-646af9a2d722 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9872024-09-16T14:46:20.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e97e121e-b4b5-4f97-aec0-26a0653b4757 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9882024-09-16T14:46:20.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e97e121e-b4b5-4f97-aec0-26a0653b4757 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9892024-09-16T14:46:20.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e97e121e-b4b5-4f97-aec0-26a0653b4757 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
9902024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
9912024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
9922024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9932024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9942024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
9952024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
9962024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9972024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
9982024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
9992024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10002024-09-16T14:46:21.554ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
10012024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10022024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
10032024-09-16T14:46:21.554ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
10042024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
10052024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
10062024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
10072024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10082024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
10092024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10102024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
10112024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
10122024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10132024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
10142024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
10152024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
10162024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
10172024-09-16T14:46:21.554ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-16 14:36:21.554803992 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
10182024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
10192024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
10202024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10212024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
10222024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10232024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
10242024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10252024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
10262024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
10272024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10282024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10292024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
10302024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10312024-09-16T14:46:21.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
10322024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
10332024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10342024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
10352024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10362024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
10372024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10382024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10392024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
10402024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10412024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
10422024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
10432024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10442024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
10452024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
10462024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10472024-09-16T14:46:21.555ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2
10482024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
10492024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.47\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2"}
10502024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
10512024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
10522024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10532024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10542024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10552024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10562024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
10572024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10582024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
10592024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10602024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10612024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10622024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
10632024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10642024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10652024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10662024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10672024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10682024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10692024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10702024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10712024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10722024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
10732024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10742024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10752024-09-16T14:46:21.555ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("216291e2-64d0-4e57-82ea-84523304c97b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fcbfd0d4-0b48-4392-95df-b0bdb2c97118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fcbfd0d4-0b48-4392-95df-b0bdb2c97118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 24070, tv_nsec: 514269931 } })
10762024-09-16T14:46:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
10772024-09-16T14:46:21.556ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0839d410-88e5-4168-91a3-1340a5d7a912.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f93623c-a4f4-43d1-b285-fdbdeccdc7e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fc6cb4c7-5a91-4879-8aba-57c83b2f5553.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fc6cb4c7-5a91-4879-8aba-57c83b2f5553.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 24070, tv_nsec: 515556856 } })
10782024-09-16T14:46:21.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10792024-09-16T14:46:21.557ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
10802024-09-16T14:46:21.557ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.106299ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
10812024-09-16T14:46:21.558ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
10822024-09-16T14:46:21.558ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.905564ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
10832024-09-16T14:46:21.559ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.085157ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10842024-09-16T14:46:21.559ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10852024-09-16T14:46:21.559ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10862024-09-16T14:46:21.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10872024-09-16T14:46:21.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10882024-09-16T14:46:21.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10892024-09-16T14:46:21.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10902024-09-16T14:46:21.560ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24070, tv_nsec: 519249386 } })
10912024-09-16T14:46:21.560ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
10922024-09-16T14:46:21.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
10932024-09-16T14:46:21.561ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
10942024-09-16T14:46:21.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
10952024-09-16T14:46:21.562ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10962024-09-16T14:46:21.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10972024-09-16T14:46:21.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10982024-09-16T14:46:21.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10992024-09-16T14:46:21.563ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
11002024-09-16T14:46:21.563ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
11012024-09-16T14:46:21.563ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 8.637234ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
11022024-09-16T14:46:21.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11032024-09-16T14:46:21.564ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11042024-09-16T14:46:21.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11052024-09-16T14:46:21.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11062024-09-16T14:46:21.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11072024-09-16T14:46:21.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11082024-09-16T14:46:21.566ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-16 14:36:21.554803992 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
11092024-09-16T14:46:21.566ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.600631ms iteration = 6 status = {"expiration":"2024-09-16T14:36:21.554803992Z","pruned":[]}
11102024-09-16T14:46:21.567ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11112024-09-16T14:46:21.567ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
11122024-09-16T14:46:21.567ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11132024-09-16T14:46:21.567ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11142024-09-16T14:46:21.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11152024-09-16T14:46:21.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11162024-09-16T14:46:21.569ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24070, tv_nsec: 528393100 } })
11172024-09-16T14:46:21.570ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11182024-09-16T14:46:21.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11192024-09-16T14:46:21.571ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
11202024-09-16T14:46:21.571ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.383072ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
11212024-09-16T14:46:21.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11222024-09-16T14:46:21.573ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.235757ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
11232024-09-16T14:46:21.573ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
11242024-09-16T14:46:21.573ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11252024-09-16T14:46:21.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11262024-09-16T14:46:21.577ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11272024-09-16T14:46:21.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11282024-09-16T14:46:21.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11292024-09-16T14:46:21.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11302024-09-16T14:46:21.578ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
11312024-09-16T14:46:21.578ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11322024-09-16T14:46:21.578ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11332024-09-16T14:46:21.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11342024-09-16T14:46:21.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11352024-09-16T14:46:21.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11362024-09-16T14:46:21.581ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11372024-09-16T14:46:21.581ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11382024-09-16T14:46:21.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11392024-09-16T14:46:21.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11402024-09-16T14:46:21.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11412024-09-16T14:46:21.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11422024-09-16T14:46:21.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.736869ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
11432024-09-16T14:46:21.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
11442024-09-16T14:46:21.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11452024-09-16T14:46:21.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11462024-09-16T14:46:21.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11472024-09-16T14:46:21.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11482024-09-16T14:46:21.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11492024-09-16T14:46:21.620ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11502024-09-16T14:46:21.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11512024-09-16T14:46:21.620ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11522024-09-16T14:46:21.621ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11532024-09-16T14:46:21.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11542024-09-16T14:46:21.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11552024-09-16T14:46:21.621ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11562024-09-16T14:46:21.621ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24070, tv_nsec: 580450782 } })
11572024-09-16T14:46:21.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11582024-09-16T14:46:21.622ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
11592024-09-16T14:46:21.622ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.343223ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11602024-09-16T14:46:21.622ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11612024-09-16T14:46:21.622ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11622024-09-16T14:46:21.623ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11632024-09-16T14:46:21.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11642024-09-16T14:46:21.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11652024-09-16T14:46:21.623ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11662024-09-16T14:46:21.624ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11672024-09-16T14:46:21.625ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11682024-09-16T14:46:21.625ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
11692024-09-16T14:46:21.625ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:226 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11702024-09-16T14:46:21.625ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 70.794628ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
11712024-09-16T14:46:21.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11722024-09-16T14:46:21.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
11732024-09-16T14:46:21.627ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11742024-09-16T14:46:21.627ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11752024-09-16T14:46:21.628ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11762024-09-16T14:46:21.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11772024-09-16T14:46:21.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11782024-09-16T14:46:21.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
11792024-09-16T14:46:21.629ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11802024-09-16T14:46:21.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11812024-09-16T14:46:21.630ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
11822024-09-16T14:46:21.630ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
11832024-09-16T14:46:21.630ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 75.745493ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
11842024-09-16T14:46:21.633ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 78.687969ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
11852024-09-16T14:46:21.633ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11862024-09-16T14:46:21.636ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11872024-09-16T14:46:21.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 81.91494ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
11882024-09-16T14:46:21.637ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11892024-09-16T14:46:21.637ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11902024-09-16T14:46:21.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
11912024-09-16T14:46:21.637ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11922024-09-16T14:46:21.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11932024-09-16T14:46:21.639ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11942024-09-16T14:46:21.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11952024-09-16T14:46:21.640ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:539 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11962024-09-16T14:46:21.640ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 85.794894ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11972024-09-16T14:46:21.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11982024-09-16T14:46:21.641ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11992024-09-16T14:46:21.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12002024-09-16T14:46:21.641ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12012024-09-16T14:46:21.641ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12022024-09-16T14:46:21.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12032024-09-16T14:46:21.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12042024-09-16T14:46:21.644ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
12052024-09-16T14:46:21.644ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 89.400972ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
12062024-09-16T14:46:21.658ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12072024-09-16T14:46:21.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12082024-09-16T14:46:21.669ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12092024-09-16T14:46:21.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12102024-09-16T14:46:21.674ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12112024-09-16T14:46:21.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12122024-09-16T14:46:21.676ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12132024-09-16T14:46:21.681ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12142024-09-16T14:46:21.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
12152024-09-16T14:46:21.681ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12162024-09-16T14:46:21.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12172024-09-16T14:46:21.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12182024-09-16T14:46:21.685ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12192024-09-16T14:46:21.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12202024-09-16T14:46:21.688ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12212024-09-16T14:46:21.688ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12222024-09-16T14:46:21.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12232024-09-16T14:46:21.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12242024-09-16T14:46:21.691ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
12252024-09-16T14:46:21.691ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
12262024-09-16T14:46:21.691ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
12272024-09-16T14:46:21.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12282024-09-16T14:46:21.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12292024-09-16T14:46:21.691ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12302024-09-16T14:46:21.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12312024-09-16T14:46:21.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12322024-09-16T14:46:21.694ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12332024-09-16T14:46:21.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12342024-09-16T14:46:21.695ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12352024-09-16T14:46:21.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12362024-09-16T14:46:21.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12372024-09-16T14:46:21.696ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12382024-09-16T14:46:21.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12392024-09-16T14:46:21.698ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12402024-09-16T14:46:21.701ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12412024-09-16T14:46:21.701ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12422024-09-16T14:46:21.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12432024-09-16T14:46:21.701ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
12442024-09-16T14:46:21.701ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
12452024-09-16T14:46:21.701ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
12462024-09-16T14:46:21.701ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12472024-09-16T14:46:21.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12482024-09-16T14:46:21.703ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12492024-09-16T14:46:21.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12502024-09-16T14:46:21.704ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12512024-09-16T14:46:21.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12522024-09-16T14:46:21.705ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12532024-09-16T14:46:21.705ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
12542024-09-16T14:46:21.705ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12552024-09-16T14:46:21.708ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8b1d889d-4ec0-4f43-b794-85696748ff64", "content-length": "26", "date": "Mon, 16 Sep 2024 14:46:20 GMT"} })
12562024-09-16T14:46:21.708ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12572024-09-16T14:46:21.710ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12582024-09-16T14:46:21.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12592024-09-16T14:46:21.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12602024-09-16T14:46:21.712ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12612024-09-16T14:46:21.712ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12622024-09-16T14:46:21.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
12632024-09-16T14:46:21.717ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12642024-09-16T14:46:21.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12652024-09-16T14:46:21.720ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12662024-09-16T14:46:21.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12672024-09-16T14:46:21.722ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 167.143114ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
12682024-09-16T14:46:21.722ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12692024-09-16T14:46:21.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12702024-09-16T14:46:21.725ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12712024-09-16T14:46:21.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12722024-09-16T14:46:21.729ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
12732024-09-16T14:46:21.731ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12742024-09-16T14:46:21.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12752024-09-16T14:46:21.731ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
12762024-09-16T14:46:21.731ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12772024-09-16T14:46:21.731ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "39d62a68-af4a-467b-aded-b859a2542439", "content-length": "26", "date": "Mon, 16 Sep 2024 14:46:20 GMT"} })
12782024-09-16T14:46:21.731ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12792024-09-16T14:46:21.733ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12802024-09-16T14:46:21.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12812024-09-16T14:46:21.733ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12822024-09-16T14:46:21.735ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12832024-09-16T14:46:21.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12842024-09-16T14:46:21.737ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12852024-09-16T14:46:21.737ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12862024-09-16T14:46:21.741ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
12872024-09-16T14:46:21.741ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 01c7aafc-c1b7-42bb-a493-0c643f2e21db dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
12882024-09-16T14:46:21.742ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12892024-09-16T14:46:21.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12902024-09-16T14:46:21.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f26461d2-04fe-40aa-80c2-1eb0bc461628, lookup_type: ById(f26461d2-04fe-40aa-80c2-1eb0bc461628) } result = Ok(())
12912024-09-16T14:46:21.742ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12922024-09-16T14:46:21.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12932024-09-16T14:46:21.743ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
12942024-09-16T14:46:21.743ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12952024-09-16T14:46:21.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12962024-09-16T14:46:21.744ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12972024-09-16T14:46:21.745ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 190.713023ms iteration = 11 status = 0
12982024-09-16T14:46:21.746ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12992024-09-16T14:46:21.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13002024-09-16T14:46:21.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13012024-09-16T14:46:21.749ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13022024-09-16T14:46:21.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13032024-09-16T14:46:21.750ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
13042024-09-16T14:46:21.750ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d70d9c11-14c5-40d0-be17-039af1ae521e dns_zone_name = oxide.test found_so_far = 0 version = 2
13052024-09-16T14:46:21.750ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13062024-09-16T14:46:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13072024-09-16T14:46:21.750ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-16T14:41:19.171997Z, time_modified: 2024-09-16T14:41:19.171997Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2f0f2dc2-cb37-4fec-9d0b-492287602073, db_silo: Silo { identity: SiloIdentity { id: 2f0f2dc2-cb37-4fec-9d0b-492287602073, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-16T14:41:24.495850Z, time_modified: 2024-09-16T14:41:24.495850Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7a1e72c489a058dd07f837cad69c701f6b45e7cf21c6d4f626d443caf9673a83" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2f0f2dc2-cb37-4fec-9d0b-492287602073, db_silo: Silo { identity: SiloIdentity { id: 2f0f2dc2-cb37-4fec-9d0b-492287602073, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-16T14:41:24.495850Z, time_modified: 2024-09-16T14:41:24.495850Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7a1e72c489a058dd07f837cad69c701f6b45e7cf21c6d4f626d443caf9673a83" }] }) }
13082024-09-16T14:46:21.750ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 195.944972ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2f0f2dc2-cb37-4fec-9d0b-492287602073","tls_certs":["7a1e72c489a058dd07f837cad69c701f6b45e7cf21c6d4f626d443caf9673a83"]}},"default_endpoint":{"silo_id":"2f0f2dc2-cb37-4fec-9d0b-492287602073","tls_certs":["7a1e72c489a058dd07f837cad69c701f6b45e7cf21c6d4f626d443caf9673a83"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
13092024-09-16T14:46:21.750ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
13102024-09-16T14:46:21.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e7db2c64-e720-40a7-8cf7-b04b9d4a9c62 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
13112024-09-16T14:46:21.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e7db2c64-e720-40a7-8cf7-b04b9d4a9c62 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
13122024-09-16T14:46:21.752ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13132024-09-16T14:46:21.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13142024-09-16T14:46:21.753ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13152024-09-16T14:46:21.754ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13162024-09-16T14:46:21.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e7db2c64-e720-40a7-8cf7-b04b9d4a9c62 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
13172024-09-16T14:46:21.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13182024-09-16T14:46:21.757ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13192024-09-16T14:46:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13202024-09-16T14:46:21.759ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
13212024-09-16T14:46:21.759ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13222024-09-16T14:46:21.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13232024-09-16T14:46:21.764ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d70d9c11-14c5-40d0-be17-039af1ae521e dns_zone_name = oxide.test found_so_far = 1 version = 2
13242024-09-16T14:46:21.764ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
13252024-09-16T14:46:21.764ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-16 14:41:24.562175 UTC dns_group = external generation = 2
13262024-09-16T14:46:21.764ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 209.978079ms iteration = 7 status = {"generation":2}
13272024-09-16T14:46:21.766ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 01c7aafc-c1b7-42bb-a493-0c643f2e21db dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
13282024-09-16T14:46:21.766ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
13292024-09-16T14:46:21.766ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-16 14:41:23.295040 UTC dns_group = internal generation = 1
13302024-09-16T14:46:21.766ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 211.889436ms iteration = 7 status = {"generation":1}
13312024-09-16T14:46:21.791ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 237.210368ms iteration = 14 status = {"physical_disks_added":0}
13322024-09-16T14:46:21.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13332024-09-16T14:46:21.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13342024-09-16T14:46:21.896ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
13352024-09-16T14:46:21.896ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b558919b-50a3-457b-8686-3c094eeac624", "content-length": "1", "date": "Mon, 16 Sep 2024 14:46:21 GMT"} })
13362024-09-16T14:46:21.898ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13372024-09-16T14:46:21.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13382024-09-16T14:46:21.899ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 345.328388ms iteration = 11 status = {}
13392024-09-16T14:46:21.914ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
13402024-09-16T14:46:21.928ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 zone_address = fd00:1122:3344:101::2
13412024-09-16T14:46:21.928ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13422024-09-16T14:46:21.928ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0b1a9707-90fc-4407-a3ae-501de3667875", "content-length": "26", "date": "Mon, 16 Sep 2024 14:46:21 GMT"} })
13432024-09-16T14:46:21.928ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13442024-09-16T14:46:21.930ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
13452024-09-16T14:46:22.030ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
13462024-09-16T14:46:22.031ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "149fd351-04be-4c7e-810a-5f8dd7d8364c", "date": "Mon, 16 Sep 2024 14:46:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13472024-09-16T14:46:22.031ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13482024-09-16T14:46:22.032ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d1d8dbf2-e533-4d77-9582-b60f9fcbdcbb", "date": "Mon, 16 Sep 2024 14:46:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13492024-09-16T14:46:22.032ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13502024-09-16T14:46:22.034ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ccb13d58-d5ac-416f-ab6f-f9268d3d561a", "date": "Mon, 16 Sep 2024 14:46:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13512024-09-16T14:46:22.034ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13522024-09-16T14:46:22.036ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13532024-09-16T14:46:22.036ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 481.817657ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
13542024-09-16T14:46:22.053ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13552024-09-16T14:46:22.053ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a99cc762-b9ba-493b-baf6-a1462bfe7019", "content-length": "372", "date": "Mon, 16 Sep 2024 14:46:22 GMT"} })
13562024-09-16T14:46:22.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13572024-09-16T14:46:22.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13582024-09-16T14:46:22.055ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
13592024-09-16T14:46:22.056ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13602024-09-16T14:46:22.056ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 501.557424ms iteration = 11 status = null
13612024-09-16T14:46:22.056ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d148c9e6-84d5-494a-aff5-c3d4e05652d4", "date": "Mon, 16 Sep 2024 14:46:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13622024-09-16T14:46:22.056ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13632024-09-16T14:46:22.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13642024-09-16T14:46:22.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13652024-09-16T14:46:22.058ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13662024-09-16T14:46:22.058ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13672024-09-16T14:46:22.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13682024-09-16T14:46:22.058ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "43209ac8-64d7-48bc-b836-34d89dd14cb9", "date": "Mon, 16 Sep 2024 14:46:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13692024-09-16T14:46:22.058ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13702024-09-16T14:46:22.059ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13712024-09-16T14:46:22.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13722024-09-16T14:46:22.060ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13732024-09-16T14:46:22.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13742024-09-16T14:46:22.061ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13752024-09-16T14:46:22.061ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 506.542128ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
13762024-09-16T14:46:22.064ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13772024-09-16T14:46:22.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13782024-09-16T14:46:22.067ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13792024-09-16T14:46:22.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13802024-09-16T14:46:22.068ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13812024-09-16T14:46:22.069ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8b373be6-4e7a-4842-abb6-7267bf632aeb", "date": "Mon, 16 Sep 2024 14:46:22 GMT"} })
13822024-09-16T14:46:22.069ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13832024-09-16T14:46:22.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13842024-09-16T14:46:22.071ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 516.471687ms iteration = 12 status = {}
13852024-09-16T14:46:22.073ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13862024-09-16T14:46:22.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13872024-09-16T14:46:22.074ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13882024-09-16T14:46:22.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13892024-09-16T14:46:22.076ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13902024-09-16T14:46:22.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13912024-09-16T14:46:22.077ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13922024-09-16T14:46:22.082ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
13932024-09-16T14:46:22.082ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13942024-09-16T14:46:22.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13952024-09-16T14:46:22.083ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13962024-09-16T14:46:22.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13972024-09-16T14:46:22.093ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13982024-09-16T14:46:22.095ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13992024-09-16T14:46:22.095ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14002024-09-16T14:46:22.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14012024-09-16T14:46:22.110ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14022024-09-16T14:46:22.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14032024-09-16T14:46:22.112ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14042024-09-16T14:46:22.115ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
14052024-09-16T14:46:22.115ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14062024-09-16T14:46:22.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14072024-09-16T14:46:22.121ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14082024-09-16T14:46:22.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14092024-09-16T14:46:22.122ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 23db4cec-0b26-446c-96b5-1f5586deae8f, kind: Service { id: 1ee13a98-c783-4c45-9593-448411671260 }, name: Name("nexus-1ee13a98-c783-4c45-9593-448411671260"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77aacb15-62c9-4b38-9aec-31d129b37a57, kind: Service { id: 462be26e-457a-41d2-bbd8-1e15a3b16f70 }, name: Name("nexus-462be26e-457a-41d2-bbd8-1e15a3b16f70"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d937e6f4-c37f-4e58-9f07-29b8c7e410f1, kind: Service { id: 22366698-bbc7-4459-a306-c29831fda914 }, name: Name("nexus-22366698-bbc7-4459-a306-c29831fda914"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 181])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 0209958c-a258-4b69-96ed-8ac2c8710e44, kind: Service { id: fcbfd0d4-0b48-4392-95df-b0bdb2c97118 }, name: Name("external-dns-fcbfd0d4-0b48-4392-95df-b0bdb2c97118"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 198])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d92164c2-5a56-4d60-8c81-dc1f28593a20, kind: Service { id: 216291e2-64d0-4e57-82ea-84523304c97b }, name: Name("external-dns-216291e2-64d0-4e57-82ea-84523304c97b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 174])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
14102024-09-16T14:46:22.122ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14112024-09-16T14:46:22.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14122024-09-16T14:46:22.123ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 94d6770e-63ed-455d-aa9f-8ad47c66c84e, rack_id: 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bc13c6ca-2923-40a0-a45c-bfa5d94842d2) } rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0
14132024-09-16T14:46:22.123ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14142024-09-16T14:46:22.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14152024-09-16T14:46:22.131ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
14162024-09-16T14:46:22.131ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fcec8cdf-3222-4907-8083-fe24793312f9", "content-length": "121", "date": "Mon, 16 Sep 2024 14:46:21 GMT"} })
14172024-09-16T14:46:22.131ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
14182024-09-16T14:46:22.131ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bc13c6ca-2923-40a0-a45c-bfa5d94842d2
14192024-09-16T14:46:22.132ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
14202024-09-16T14:46:22.132ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
14212024-09-16T14:46:22.132ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {}
14222024-09-16T14:46:22.132ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {}
14232024-09-16T14:46:22.132ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
14242024-09-16T14:46:22.132ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14252024-09-16T14:46:22.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14262024-09-16T14:46:22.136ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
14272024-09-16T14:46:22.136ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "956635b6-8060-4cb9-ac57-cac4604ffa8c", "content-length": "2", "date": "Mon, 16 Sep 2024 14:46:21 GMT"} })
14282024-09-16T14:46:22.136ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
14292024-09-16T14:46:22.136ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e4ff2ece-72ef-4c06-adc7-68b31b84a2be", "content-length": "52", "date": "Mon, 16 Sep 2024 14:46:21 GMT"} })
14302024-09-16T14:46:22.136ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0
14312024-09-16T14:46:22.136ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
14322024-09-16T14:46:22.156ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14332024-09-16T14:46:22.158ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
14342024-09-16T14:46:22.158ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14352024-09-16T14:46:22.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14362024-09-16T14:46:22.160ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
14372024-09-16T14:46:22.160ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0209958c-a258-4b69-96ed-8ac2c8710e44, kind: Service { id: fcbfd0d4-0b48-4392-95df-b0bdb2c97118 }, name: Name("external-dns-fcbfd0d4-0b48-4392-95df-b0bdb2c97118"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 198])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d92164c2-5a56-4d60-8c81-dc1f28593a20, kind: Service { id: 216291e2-64d0-4e57-82ea-84523304c97b }, name: Name("external-dns-216291e2-64d0-4e57-82ea-84523304c97b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 174])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 23db4cec-0b26-446c-96b5-1f5586deae8f, kind: Service { id: 1ee13a98-c783-4c45-9593-448411671260 }, name: Name("nexus-1ee13a98-c783-4c45-9593-448411671260"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 77aacb15-62c9-4b38-9aec-31d129b37a57, kind: Service { id: 462be26e-457a-41d2-bbd8-1e15a3b16f70 }, name: Name("nexus-462be26e-457a-41d2-bbd8-1e15a3b16f70"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d937e6f4-c37f-4e58-9f07-29b8c7e410f1, kind: Service { id: 22366698-bbc7-4459-a306-c29831fda914 }, name: Name("nexus-22366698-bbc7-4459-a306-c29831fda914"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 181])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
14382024-09-16T14:46:22.160ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
14392024-09-16T14:46:22.197ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
14402024-09-16T14:46:22.251ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4a212083-4109-41a0-ad42-bab8c0ab2547", "date": "Mon, 16 Sep 2024 14:46:22 GMT"} })
14412024-09-16T14:46:22.251ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch = Switch0
14422024-09-16T14:46:22.251ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
14432024-09-16T14:46:22.256ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c01e8d60-ba12-4288-9818-f3231bd50c18", "content-length": "667", "date": "Mon, 16 Sep 2024 14:46:22 GMT"} })
14442024-09-16T14:46:22.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14452024-09-16T14:46:22.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14462024-09-16T14:46:22.257ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a25802c7-e814-4cc9-a49c-006ad860d7da", "content-length": "691", "date": "Mon, 16 Sep 2024 14:46:21 GMT"} })
14472024-09-16T14:46:22.257ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
14482024-09-16T14:46:22.257ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
14492024-09-16T14:46:22.257ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
14502024-09-16T14:46:22.258ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 703.643622ms iteration = 11 status = {}
14512024-09-16T14:46:22.260ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14522024-09-16T14:46:22.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14532024-09-16T14:46:22.264ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14542024-09-16T14:46:22.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14552024-09-16T14:46:22.264ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: f26461d2-04fe-40aa-80c2-1eb0bc461628, time_created: 2024-09-16T14:41:21.503773Z, time_modified: 2024-09-16T14:41:21.503773Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
14562024-09-16T14:46:22.264ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
14572024-09-16T14:46:22.264ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14582024-09-16T14:46:22.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14592024-09-16T14:46:22.266ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14602024-09-16T14:46:22.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14612024-09-16T14:46:22.266ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14622024-09-16T14:46:22.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14632024-09-16T14:46:22.268ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14642024-09-16T14:46:22.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: f26461d2-04fe-40aa-80c2-1eb0bc461628, lookup_type: ById(f26461d2-04fe-40aa-80c2-1eb0bc461628) } result = Ok(())
14652024-09-16T14:46:22.274ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 719.551065ms iteration = 11 status = {}
14662024-09-16T14:46:22.301ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
14672024-09-16T14:46:22.302ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = service_firewall_rule_propagation result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6e2f8a8a-1f87-462b-8c1a-44e864cdb2ac", "date": "Mon, 16 Sep 2024 14:46:22 GMT"} })
14682024-09-16T14:46:22.303ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
14692024-09-16T14:46:22.303ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 748.389715ms
14702024-09-16T14:46:22.303ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 748.400085ms iteration = 2 status = {}
14712024-09-16T14:46:22.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 479b83e9-af3f-4d4c-a873-0759ad39c113 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
14722024-09-16T14:46:22.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 479b83e9-af3f-4d4c-a873-0759ad39c113 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
14732024-09-16T14:46:22.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1855 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 479b83e9-af3f-4d4c-a873-0759ad39c113 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
14742024-09-16T14:46:23.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f51c88bf-4fdf-48fe-9624-a9f38a7a4b7d roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
14752024-09-16T14:46:23.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f51c88bf-4fdf-48fe-9624-a9f38a7a4b7d resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
14762024-09-16T14:46:23.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f51c88bf-4fdf-48fe-9624-a9f38a7a4b7d response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
14772024-09-16T14:46:24.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 20825205-101f-4b91-b9cb-c7a97d78711e roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
14782024-09-16T14:46:24.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 20825205-101f-4b91-b9cb-c7a97d78711e resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
14792024-09-16T14:46:24.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2610 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 20825205-101f-4b91-b9cb-c7a97d78711e response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
14802024-09-16T14:46:25.736ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1208 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = 0801ec1a-bdec-4c2c-b7ef-86bd41671c63 response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
14812024-09-16T14:46:25.737ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
14822024-09-16T14:46:25.737ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
14832024-09-16T14:46:25.767ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
14842024-09-16T14:46:25.767ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:47181
14852024-09-16T14:46:25.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47181 req_id = dbe7001e-bf2b-4ec8-878c-cde8d2741e83 roles = RoleSet { roles: {} } uri = /metrics/producers
14862024-09-16T14:46:25.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47181 req_id = dbe7001e-bf2b-4ec8-878c-cde8d2741e83 resource = Database result = Ok(()) uri = /metrics/producers
14872024-09-16T14:46:25.801ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d9cae32d-8e84-4f97-9d87-f815a97563b7
14882024-09-16T14:46:25.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47181 req_id = dbe7001e-bf2b-4ec8-878c-cde8d2741e83 roles = RoleSet { roles: {} } uri = /metrics/producers
14892024-09-16T14:46:25.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47181 req_id = dbe7001e-bf2b-4ec8-878c-cde8d2741e83 resource = Database result = Ok(()) uri = /metrics/producers
14902024-09-16T14:46:25.849ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 uri = http://[fd00:1122:3344:101::d]:12223/producers
14912024-09-16T14:46:25.850ZDEBGnexus: client response oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "95ca45d3-9f7e-4d0b-9aaa-23a644c49e83", "date": "Mon, 16 Sep 2024 14:46:25 GMT"} })
14922024-09-16T14:46:25.850ZINFOnexus: assigned collector to new producer collector_id = d9cae32d-8e84-4f97-9d87-f815a97563b7 file = nexus/src/app/oximeter.rs:125 producer_id = 1ee13a98-c783-4c45-9593-448411671260
14932024-09-16T14:46:25.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 83485 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47181 req_id = dbe7001e-bf2b-4ec8-878c-cde8d2741e83 response_code = 201 uri = /metrics/producers
14942024-09-16T14:46:25.851ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "dbe7001e-bf2b-4ec8-878c-cde8d2741e83", "content-length": "41", "date": "Mon, 16 Sep 2024 14:46:25 GMT"} })
14952024-09-16T14:46:25.853ZDEBGnexus (producer-registration-task): registered with nexus successfully
14962024-09-16T14:46:25.853ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
14972024-09-16T14:46:25.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3d422003-cc3c-426f-8d29-061a8a9c2967 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
14982024-09-16T14:46:25.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3d422003-cc3c-426f-8d29-061a8a9c2967 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
14992024-09-16T14:46:25.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3d422003-cc3c-426f-8d29-061a8a9c2967 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15002024-09-16T14:46:26.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 76dae147-16a4-4b74-a37b-67184a26805a roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15012024-09-16T14:46:26.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 76dae147-16a4-4b74-a37b-67184a26805a resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15022024-09-16T14:46:26.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 76dae147-16a4-4b74-a37b-67184a26805a response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15032024-09-16T14:46:27.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8f3bfda4-3ca9-4173-be65-d4cab3937aaa roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15042024-09-16T14:46:27.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8f3bfda4-3ca9-4173-be65-d4cab3937aaa resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15052024-09-16T14:46:27.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8f3bfda4-3ca9-4173-be65-d4cab3937aaa response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15062024-09-16T14:46:28.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 08393601-1746-4bf6-911d-35531e40c623 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15072024-09-16T14:46:28.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 08393601-1746-4bf6-911d-35531e40c623 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15082024-09-16T14:46:28.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 08393601-1746-4bf6-911d-35531e40c623 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15092024-09-16T14:46:29.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5eccd83e-f84b-4358-b99c-d8631258fca1 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15102024-09-16T14:46:29.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5eccd83e-f84b-4358-b99c-d8631258fca1 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15112024-09-16T14:46:29.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5eccd83e-f84b-4358-b99c-d8631258fca1 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15122024-09-16T14:46:30.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8bebc602-137a-41b8-8d3f-b38495e092b7 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15132024-09-16T14:46:30.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8bebc602-137a-41b8-8d3f-b38495e092b7 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15142024-09-16T14:46:30.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1579 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8bebc602-137a-41b8-8d3f-b38495e092b7 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15152024-09-16T14:46:31.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
15162024-09-16T14:46:31.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
15172024-09-16T14:46:31.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15182024-09-16T14:46:31.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15192024-09-16T14:46:31.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15202024-09-16T14:46:31.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15212024-09-16T14:46:31.556ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15222024-09-16T14:46:31.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15232024-09-16T14:46:31.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15242024-09-16T14:46:31.558ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.065117ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15252024-09-16T14:46:31.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15262024-09-16T14:46:31.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15272024-09-16T14:46:31.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15282024-09-16T14:46:31.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15292024-09-16T14:46:31.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15302024-09-16T14:46:31.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15312024-09-16T14:46:31.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
15322024-09-16T14:46:31.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15332024-09-16T14:46:31.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15342024-09-16T14:46:31.571ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
15352024-09-16T14:46:31.571ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.847011ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
15362024-09-16T14:46:31.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4ad9cc88-00b1-4bbf-9808-d064df0196d8 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15372024-09-16T14:46:31.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4ad9cc88-00b1-4bbf-9808-d064df0196d8 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15382024-09-16T14:46:31.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4ad9cc88-00b1-4bbf-9808-d064df0196d8 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15392024-09-16T14:46:33.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 2bfa9d0e-a3b5-48a0-aeb1-db6dfec1eea4 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15402024-09-16T14:46:33.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 2bfa9d0e-a3b5-48a0-aeb1-db6dfec1eea4 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15412024-09-16T14:46:33.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 2bfa9d0e-a3b5-48a0-aeb1-db6dfec1eea4 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15422024-09-16T14:46:34.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 604ec634-58da-4f38-a16e-9aa0a7aa7dca roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15432024-09-16T14:46:34.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 604ec634-58da-4f38-a16e-9aa0a7aa7dca resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15442024-09-16T14:46:34.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1566 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 604ec634-58da-4f38-a16e-9aa0a7aa7dca response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15452024-09-16T14:46:34.228ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:45973
15462024-09-16T14:46:34.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45973 req_id = cf657a05-b88c-48bb-ab9a-863c9e0d2b6a roles = RoleSet { roles: {} } uri = /metrics/producers
15472024-09-16T14:46:34.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45973 req_id = cf657a05-b88c-48bb-ab9a-863c9e0d2b6a resource = Database result = Ok(()) uri = /metrics/producers
15482024-09-16T14:46:34.262ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d9cae32d-8e84-4f97-9d87-f815a97563b7
15492024-09-16T14:46:34.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45973 req_id = cf657a05-b88c-48bb-ab9a-863c9e0d2b6a roles = RoleSet { roles: {} } uri = /metrics/producers
15502024-09-16T14:46:34.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45973 req_id = cf657a05-b88c-48bb-ab9a-863c9e0d2b6a resource = Database result = Ok(()) uri = /metrics/producers
15512024-09-16T14:46:34.277ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 uri = http://[fd00:1122:3344:101::d]:12223/producers
15522024-09-16T14:46:34.277ZDEBGnexus: client response oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f2132277-4ba6-4521-aefa-8661bd8d5ecd", "date": "Mon, 16 Sep 2024 14:46:34 GMT"} })
15532024-09-16T14:46:34.277ZINFOnexus: assigned collector to new producer collector_id = d9cae32d-8e84-4f97-9d87-f815a97563b7 file = nexus/src/app/oximeter.rs:125 producer_id = fe307d27-cbdb-46ee-92ad-6b959ef3bf4b
15542024-09-16T14:46:34.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 49581 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45973 req_id = cf657a05-b88c-48bb-ab9a-863c9e0d2b6a response_code = 201 uri = /metrics/producers
15552024-09-16T14:46:35.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = ccb2b2ba-bae2-433a-8544-1187a7dee589 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15562024-09-16T14:46:35.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = ccb2b2ba-bae2-433a-8544-1187a7dee589 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15572024-09-16T14:46:35.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = ccb2b2ba-bae2-433a-8544-1187a7dee589 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15582024-09-16T14:46:35.851ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1224 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = 7657765f-7a59-4e08-bbf7-35b77da03fe4 response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
15592024-09-16T14:46:36.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6fcac28c-bb3a-4fb1-92a6-507a95f66bdb roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15602024-09-16T14:46:36.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6fcac28c-bb3a-4fb1-92a6-507a95f66bdb resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15612024-09-16T14:46:36.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6fcac28c-bb3a-4fb1-92a6-507a95f66bdb response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15622024-09-16T14:46:36.833ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:36272
15632024-09-16T14:46:36.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36272 req_id = 9cc2602f-1444-4ff2-89af-0355c035c125 roles = RoleSet { roles: {} } uri = /metrics/producers
15642024-09-16T14:46:36.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36272 req_id = 9cc2602f-1444-4ff2-89af-0355c035c125 resource = Database result = Ok(()) uri = /metrics/producers
15652024-09-16T14:46:36.866ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d9cae32d-8e84-4f97-9d87-f815a97563b7
15662024-09-16T14:46:36.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36272 req_id = 9cc2602f-1444-4ff2-89af-0355c035c125 roles = RoleSet { roles: {} } uri = /metrics/producers
15672024-09-16T14:46:36.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36272 req_id = 9cc2602f-1444-4ff2-89af-0355c035c125 resource = Database result = Ok(()) uri = /metrics/producers
15682024-09-16T14:46:36.904ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 uri = http://[fd00:1122:3344:101::d]:12223/producers
15692024-09-16T14:46:36.905ZDEBGnexus: client response oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ae414d23-287c-4347-b66e-4f87833f0db6", "date": "Mon, 16 Sep 2024 14:46:36 GMT"} })
15702024-09-16T14:46:36.905ZINFOnexus: assigned collector to new producer collector_id = d9cae32d-8e84-4f97-9d87-f815a97563b7 file = nexus/src/app/oximeter.rs:125 producer_id = 04c7daf0-9be9-4202-8f00-60f03c7b20ce
15712024-09-16T14:46:36.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 74153 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36272 req_id = 9cc2602f-1444-4ff2-89af-0355c035c125 response_code = 201 uri = /metrics/producers
15722024-09-16T14:46:37.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 92800af3-bff5-461e-aa7f-1b266c490951 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15732024-09-16T14:46:37.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 92800af3-bff5-461e-aa7f-1b266c490951 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15742024-09-16T14:46:37.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1651 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 92800af3-bff5-461e-aa7f-1b266c490951 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15752024-09-16T14:46:38.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 70813634-ded3-40b9-a896-7401c909dc47 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15762024-09-16T14:46:38.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 70813634-ded3-40b9-a896-7401c909dc47 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15772024-09-16T14:46:38.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 70813634-ded3-40b9-a896-7401c909dc47 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15782024-09-16T14:46:39.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 927a25b1-8976-450f-bb57-9c3c690cb292 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15792024-09-16T14:46:39.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 927a25b1-8976-450f-bb57-9c3c690cb292 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15802024-09-16T14:46:39.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 927a25b1-8976-450f-bb57-9c3c690cb292 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15812024-09-16T14:46:40.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 27233165-1797-4176-8f77-1e92b5027be0 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15822024-09-16T14:46:40.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 27233165-1797-4176-8f77-1e92b5027be0 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15832024-09-16T14:46:40.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 27233165-1797-4176-8f77-1e92b5027be0 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15842024-09-16T14:46:41.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = aa0e69cc-1a4d-4024-b94a-f7e4577d6a6c roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15852024-09-16T14:46:41.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = aa0e69cc-1a4d-4024-b94a-f7e4577d6a6c resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15862024-09-16T14:46:41.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1800 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = aa0e69cc-1a4d-4024-b94a-f7e4577d6a6c response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
15872024-09-16T14:46:41.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
15882024-09-16T14:46:41.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
15892024-09-16T14:46:41.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15902024-09-16T14:46:41.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15912024-09-16T14:46:41.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15922024-09-16T14:46:41.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15932024-09-16T14:46:41.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15942024-09-16T14:46:41.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15952024-09-16T14:46:41.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15962024-09-16T14:46:41.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15972024-09-16T14:46:41.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15982024-09-16T14:46:41.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15992024-09-16T14:46:41.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16002024-09-16T14:46:41.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
16012024-09-16T14:46:41.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16022024-09-16T14:46:41.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16032024-09-16T14:46:41.575ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
16042024-09-16T14:46:41.575ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.764485ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
16052024-09-16T14:46:41.585ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16062024-09-16T14:46:41.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16072024-09-16T14:46:41.587ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.988469ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16082024-09-16T14:46:42.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 153b9bc7-ac1c-4a78-8d24-eddd925ce98b roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16092024-09-16T14:46:42.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 153b9bc7-ac1c-4a78-8d24-eddd925ce98b resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16102024-09-16T14:46:42.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 153b9bc7-ac1c-4a78-8d24-eddd925ce98b response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16112024-09-16T14:46:43.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 54fe19a6-4c6a-4cd5-84b4-2930473acb52 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16122024-09-16T14:46:43.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 54fe19a6-4c6a-4cd5-84b4-2930473acb52 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16132024-09-16T14:46:43.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 54fe19a6-4c6a-4cd5-84b4-2930473acb52 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16142024-09-16T14:46:44.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7230c823-209d-411c-97c1-eed52de06c4f roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16152024-09-16T14:46:44.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7230c823-209d-411c-97c1-eed52de06c4f resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16162024-09-16T14:46:44.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7230c823-209d-411c-97c1-eed52de06c4f response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16172024-09-16T14:46:45.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3078b06b-6ef7-4560-9db1-5b4f2ebb0836 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16182024-09-16T14:46:45.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3078b06b-6ef7-4560-9db1-5b4f2ebb0836 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16192024-09-16T14:46:45.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1736 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3078b06b-6ef7-4560-9db1-5b4f2ebb0836 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16202024-09-16T14:46:45.852ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1231 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = da00316f-8b60-4fe9-957a-3e893347ca39 response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
16212024-09-16T14:46:46.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e92fb10b-c789-4507-9ce9-589c945598a5 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16222024-09-16T14:46:46.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e92fb10b-c789-4507-9ce9-589c945598a5 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16232024-09-16T14:46:46.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1817 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e92fb10b-c789-4507-9ce9-589c945598a5 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16242024-09-16T14:46:47.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a953e2be-b697-4fdc-a09a-f717425edaa2 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16252024-09-16T14:46:47.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a953e2be-b697-4fdc-a09a-f717425edaa2 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16262024-09-16T14:46:47.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a953e2be-b697-4fdc-a09a-f717425edaa2 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16272024-09-16T14:46:48.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 383ef879-f219-4986-8bde-058866b092bb roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16282024-09-16T14:46:48.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 383ef879-f219-4986-8bde-058866b092bb resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16292024-09-16T14:46:48.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 383ef879-f219-4986-8bde-058866b092bb response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16302024-09-16T14:46:49.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 04351194-f20d-4da6-a967-47253db3132b roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16312024-09-16T14:46:49.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 04351194-f20d-4da6-a967-47253db3132b resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16322024-09-16T14:46:49.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2610 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 04351194-f20d-4da6-a967-47253db3132b response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16332024-09-16T14:46:50.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 66ee3e88-f86a-49b0-a3a7-34b8384f7fb0 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16342024-09-16T14:46:50.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 66ee3e88-f86a-49b0-a3a7-34b8384f7fb0 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16352024-09-16T14:46:50.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 66ee3e88-f86a-49b0-a3a7-34b8384f7fb0 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16362024-09-16T14:46:51.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 49e5068c-e39f-4886-9f0c-e26dfc7898e7 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16372024-09-16T14:46:51.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 49e5068c-e39f-4886-9f0c-e26dfc7898e7 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16382024-09-16T14:46:51.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2519 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 49e5068c-e39f-4886-9f0c-e26dfc7898e7 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
16392024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
16402024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
16412024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16422024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
16432024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16442024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16452024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
16462024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
16472024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16482024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
16492024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16502024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16512024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
16522024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
16532024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16542024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
16552024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16562024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
16572024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
16582024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
16592024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
16602024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
16612024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16622024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
16632024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16642024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
16652024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16662024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
16672024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16682024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
16692024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
16702024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16712024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
16722024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
16732024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16742024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16752024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16762024-09-16T14:46:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16772024-09-16T14:46:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16782024-09-16T14:46:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16792024-09-16T14:46:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16802024-09-16T14:46:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16812024-09-16T14:46:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16822024-09-16T14:46:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16832024-09-16T14:46:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
16842024-09-16T14:46:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16852024-09-16T14:46:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16862024-09-16T14:46:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
16872024-09-16T14:46:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16882024-09-16T14:46:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16892024-09-16T14:46:51.556ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.330255ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
16902024-09-16T14:46:51.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16912024-09-16T14:46:51.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16922024-09-16T14:46:51.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16932024-09-16T14:46:51.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
16942024-09-16T14:46:51.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16952024-09-16T14:46:51.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
16962024-09-16T14:46:51.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16972024-09-16T14:46:51.560ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16982024-09-16T14:46:51.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16992024-09-16T14:46:51.560ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17002024-09-16T14:46:51.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17012024-09-16T14:46:51.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17022024-09-16T14:46:51.561ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24100, tv_nsec: 519760776 } })
17032024-09-16T14:46:51.561ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
17042024-09-16T14:46:51.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17052024-09-16T14:46:51.563ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17062024-09-16T14:46:51.565ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24100, tv_nsec: 523710671 } })
17072024-09-16T14:46:51.565ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
17082024-09-16T14:46:51.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17092024-09-16T14:46:51.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17102024-09-16T14:46:51.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17112024-09-16T14:46:51.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
17122024-09-16T14:46:51.566ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17132024-09-16T14:46:51.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17142024-09-16T14:46:51.568ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17152024-09-16T14:46:51.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17162024-09-16T14:46:51.570ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17172024-09-16T14:46:51.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17182024-09-16T14:46:51.572ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17192024-09-16T14:46:51.573ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24100, tv_nsec: 532001229 } })
17202024-09-16T14:46:51.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17212024-09-16T14:46:51.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17222024-09-16T14:46:51.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17232024-09-16T14:46:51.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17242024-09-16T14:46:51.574ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17252024-09-16T14:46:51.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17262024-09-16T14:46:51.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
17272024-09-16T14:46:51.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17282024-09-16T14:46:51.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17292024-09-16T14:46:51.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17302024-09-16T14:46:51.592ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17312024-09-16T14:46:51.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17322024-09-16T14:46:51.593ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
17332024-09-16T14:46:51.593ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
17342024-09-16T14:46:51.593ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17352024-09-16T14:46:51.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17362024-09-16T14:46:51.596ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17372024-09-16T14:46:51.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17382024-09-16T14:46:51.598ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17392024-09-16T14:46:51.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17402024-09-16T14:46:51.599ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17412024-09-16T14:46:51.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17422024-09-16T14:46:51.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17432024-09-16T14:46:51.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17442024-09-16T14:46:51.602ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.245179ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
17452024-09-16T14:46:51.603ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.762529ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
17462024-09-16T14:46:51.606ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:539 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
17472024-09-16T14:46:51.606ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 51.623823ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
17482024-09-16T14:46:51.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17492024-09-16T14:46:51.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
17502024-09-16T14:46:51.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17512024-09-16T14:46:51.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17522024-09-16T14:46:51.615ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17532024-09-16T14:46:51.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17542024-09-16T14:46:51.617ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17552024-09-16T14:46:51.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17562024-09-16T14:46:51.668ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
17572024-09-16T14:46:51.668ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17582024-09-16T14:46:51.669ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "276943f3-a55a-4412-b6e3-c6ac5ac7f605", "content-length": "26", "date": "Mon, 16 Sep 2024 14:46:50 GMT"} })
17592024-09-16T14:46:51.669ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17602024-09-16T14:46:51.670ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17612024-09-16T14:46:51.673ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17622024-09-16T14:46:51.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17632024-09-16T14:46:51.679ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
17642024-09-16T14:46:51.679ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17652024-09-16T14:46:51.680ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "564b1fb3-4dd8-4b8d-84be-6c68a4d0e2f9", "content-length": "26", "date": "Mon, 16 Sep 2024 14:46:50 GMT"} })
17662024-09-16T14:46:51.680ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17672024-09-16T14:46:51.682ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17682024-09-16T14:46:51.700ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17692024-09-16T14:46:51.701ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d8df7dce-fedb-4451-b18e-a5a96a499220", "content-length": "372", "date": "Mon, 16 Sep 2024 14:46:51 GMT"} })
17702024-09-16T14:46:51.701ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17712024-09-16T14:46:51.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17722024-09-16T14:46:51.705ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17732024-09-16T14:46:51.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17742024-09-16T14:46:51.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17752024-09-16T14:46:51.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17762024-09-16T14:46:51.711ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 zone_address = fd00:1122:3344:101::2
17772024-09-16T14:46:51.711ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17782024-09-16T14:46:51.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17792024-09-16T14:46:51.712ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "09247a40-27e3-4c42-9d24-27c162c6ecb2", "content-length": "26", "date": "Mon, 16 Sep 2024 14:46:50 GMT"} })
17802024-09-16T14:46:51.712ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17812024-09-16T14:46:51.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17822024-09-16T14:46:51.713ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
17832024-09-16T14:46:51.714ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
17842024-09-16T14:46:51.714ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 160.155ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
17852024-09-16T14:46:51.715ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17862024-09-16T14:46:51.715ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7ba6d7f2-43cf-47e3-9ec7-2ba8d9774ad9", "date": "Mon, 16 Sep 2024 14:46:51 GMT"} })
17872024-09-16T14:46:51.717ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 162.774191ms iteration = 13 status = {}
17882024-09-16T14:46:51.729ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 174.740528ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
17892024-09-16T14:46:51.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 176.42667ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17902024-09-16T14:46:51.731ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17912024-09-16T14:46:51.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17922024-09-16T14:46:51.731ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
17932024-09-16T14:46:51.731ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
17942024-09-16T14:46:51.731ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17952024-09-16T14:46:51.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17962024-09-16T14:46:51.736ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17972024-09-16T14:46:51.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f26461d2-04fe-40aa-80c2-1eb0bc461628, lookup_type: ById(f26461d2-04fe-40aa-80c2-1eb0bc461628) } result = Ok(())
17982024-09-16T14:46:51.739ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17992024-09-16T14:46:51.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18002024-09-16T14:46:51.740ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 185.564654ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
18012024-09-16T14:46:51.741ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 186.781948ms iteration = 12 status = 0
18022024-09-16T14:46:51.759ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 204.553506ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
18032024-09-16T14:46:51.759ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
18042024-09-16T14:46:51.759ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:226 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
18052024-09-16T14:46:51.759ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 205.310111ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
18062024-09-16T14:46:51.776ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 222.07815ms iteration = 12 status = {}
18072024-09-16T14:46:51.789ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
18082024-09-16T14:46:51.790ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dd505d47-759f-47bb-91de-edbc40dc3f24", "content-length": "1", "date": "Mon, 16 Sep 2024 14:46:51 GMT"} })
18092024-09-16T14:46:51.792ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18102024-09-16T14:46:51.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18112024-09-16T14:46:51.794ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 239.883909ms iteration = 12 status = null
18122024-09-16T14:46:51.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18132024-09-16T14:46:51.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18142024-09-16T14:46:51.797ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18152024-09-16T14:46:51.800ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18162024-09-16T14:46:51.800ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18172024-09-16T14:46:51.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18182024-09-16T14:46:51.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18192024-09-16T14:46:51.803ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 248.568995ms iteration = 15 status = {"physical_disks_added":0}
18202024-09-16T14:46:51.804ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18212024-09-16T14:46:51.804ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18222024-09-16T14:46:51.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18232024-09-16T14:46:51.884ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18242024-09-16T14:46:51.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18252024-09-16T14:46:51.886ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 94d6770e-63ed-455d-aa9f-8ad47c66c84e, rack_id: 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bc13c6ca-2923-40a0-a45c-bfa5d94842d2) } rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0
18262024-09-16T14:46:51.886ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18272024-09-16T14:46:51.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18282024-09-16T14:46:51.897ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
18292024-09-16T14:46:51.897ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a191b0da-e87b-43da-ad49-6dde947b949e", "content-length": "121", "date": "Mon, 16 Sep 2024 14:46:51 GMT"} })
18302024-09-16T14:46:51.897ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
18312024-09-16T14:46:51.897ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bc13c6ca-2923-40a0-a45c-bfa5d94842d2
18322024-09-16T14:46:51.898ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
18332024-09-16T14:46:51.898ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
18342024-09-16T14:46:51.898ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {}
18352024-09-16T14:46:51.898ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {}
18362024-09-16T14:46:51.898ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
18372024-09-16T14:46:51.898ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18382024-09-16T14:46:51.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18392024-09-16T14:46:51.900ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
18402024-09-16T14:46:51.900ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4a5394c7-42b0-4211-b8f7-e88bad10aa18", "content-length": "2", "date": "Mon, 16 Sep 2024 14:46:51 GMT"} })
18412024-09-16T14:46:51.900ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
18422024-09-16T14:46:51.901ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6dc6f9df-b007-4397-bbb5-fdef3f009489", "content-length": "52", "date": "Mon, 16 Sep 2024 14:46:51 GMT"} })
18432024-09-16T14:46:51.901ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0
18442024-09-16T14:46:51.901ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18452024-09-16T14:46:51.903ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
18462024-09-16T14:46:51.999ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4483719c-5702-486e-aa72-b72703f09a12", "date": "Mon, 16 Sep 2024 14:46:51 GMT"} })
18472024-09-16T14:46:51.999ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch = Switch0
18482024-09-16T14:46:51.999ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18492024-09-16T14:46:51.999ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "87261233-1eac-4443-9d53-89046ffc710f", "content-length": "667", "date": "Mon, 16 Sep 2024 14:46:51 GMT"} })
18502024-09-16T14:46:51.999ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18512024-09-16T14:46:51.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18522024-09-16T14:46:51.999ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "66979fe5-8b08-4835-bb56-a02a58ef92be", "content-length": "691", "date": "Mon, 16 Sep 2024 14:46:51 GMT"} })
18532024-09-16T14:46:52.000ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
18542024-09-16T14:46:52.000ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
18552024-09-16T14:46:52.000ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
18562024-09-16T14:46:52.001ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 446.998304ms iteration = 12 status = {}
18572024-09-16T14:46:52.003ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18582024-09-16T14:46:52.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18592024-09-16T14:46:52.007ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18602024-09-16T14:46:52.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18612024-09-16T14:46:52.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18622024-09-16T14:46:52.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18632024-09-16T14:46:52.017ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 462.587821ms iteration = 12 status = {}
18642024-09-16T14:46:52.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8c2dbec6-3ee8-4331-83a9-84b0b0fcaf93 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18652024-09-16T14:46:52.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8c2dbec6-3ee8-4331-83a9-84b0b0fcaf93 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18662024-09-16T14:46:52.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1814 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8c2dbec6-3ee8-4331-83a9-84b0b0fcaf93 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18672024-09-16T14:46:53.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 10161034-0c0f-4e55-ab80-4c0e449a1c5d roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18682024-09-16T14:46:53.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 10161034-0c0f-4e55-ab80-4c0e449a1c5d resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18692024-09-16T14:46:53.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 10161034-0c0f-4e55-ab80-4c0e449a1c5d response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18702024-09-16T14:46:54.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 14a24e18-a34b-405b-87bc-2fffcd92b33c roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18712024-09-16T14:46:54.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 14a24e18-a34b-405b-87bc-2fffcd92b33c resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18722024-09-16T14:46:54.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 14a24e18-a34b-405b-87bc-2fffcd92b33c response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18732024-09-16T14:46:55.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = be071863-1b47-46fa-a1ac-bb6305864d1b roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18742024-09-16T14:46:55.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = be071863-1b47-46fa-a1ac-bb6305864d1b resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18752024-09-16T14:46:55.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = be071863-1b47-46fa-a1ac-bb6305864d1b response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18762024-09-16T14:46:55.851ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1292 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = b89fc47c-f7bd-45e0-ad96-30644552475a response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
18772024-09-16T14:46:56.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 9acbe92e-24da-4005-a630-67437b183c75 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18782024-09-16T14:46:56.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 9acbe92e-24da-4005-a630-67437b183c75 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18792024-09-16T14:46:56.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2581 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 9acbe92e-24da-4005-a630-67437b183c75 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18802024-09-16T14:46:57.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8d36feee-dd55-4864-b66d-a8c7477d33c5 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18812024-09-16T14:46:57.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8d36feee-dd55-4864-b66d-a8c7477d33c5 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18822024-09-16T14:46:57.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8d36feee-dd55-4864-b66d-a8c7477d33c5 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18832024-09-16T14:46:58.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = b4b78f59-3dbf-4b20-95e5-cb2ff325cf5c roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18842024-09-16T14:46:58.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = b4b78f59-3dbf-4b20-95e5-cb2ff325cf5c resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18852024-09-16T14:46:58.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = b4b78f59-3dbf-4b20-95e5-cb2ff325cf5c response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18862024-09-16T14:46:59.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f3885706-e538-458b-99b0-727dda1d8186 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18872024-09-16T14:46:59.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f3885706-e538-458b-99b0-727dda1d8186 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18882024-09-16T14:46:59.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f3885706-e538-458b-99b0-727dda1d8186 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18892024-09-16T14:47:00.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = bf3352ff-d953-4ce2-8a76-50b4ed17f90d roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18902024-09-16T14:47:00.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = bf3352ff-d953-4ce2-8a76-50b4ed17f90d resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18912024-09-16T14:47:00.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = bf3352ff-d953-4ce2-8a76-50b4ed17f90d response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
18922024-09-16T14:47:01.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
18932024-09-16T14:47:01.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18942024-09-16T14:47:01.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
18952024-09-16T14:47:01.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18962024-09-16T14:47:01.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18972024-09-16T14:47:01.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18982024-09-16T14:47:01.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18992024-09-16T14:47:01.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19002024-09-16T14:47:01.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19012024-09-16T14:47:01.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19022024-09-16T14:47:01.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19032024-09-16T14:47:01.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19042024-09-16T14:47:01.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19052024-09-16T14:47:01.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
19062024-09-16T14:47:01.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19072024-09-16T14:47:01.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19082024-09-16T14:47:01.571ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
19092024-09-16T14:47:01.571ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.568746ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
19102024-09-16T14:47:01.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19112024-09-16T14:47:01.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19122024-09-16T14:47:01.608ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.996809ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19132024-09-16T14:47:01.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 917a54ee-153b-4b59-8248-fa9179c81aaf roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19142024-09-16T14:47:01.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 917a54ee-153b-4b59-8248-fa9179c81aaf resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19152024-09-16T14:47:01.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1465 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 917a54ee-153b-4b59-8248-fa9179c81aaf response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19162024-09-16T14:47:02.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 16fecac7-7cb0-4b17-9aaf-d8f816a6d8c4 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19172024-09-16T14:47:02.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 16fecac7-7cb0-4b17-9aaf-d8f816a6d8c4 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19182024-09-16T14:47:02.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 16fecac7-7cb0-4b17-9aaf-d8f816a6d8c4 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19192024-09-16T14:47:03.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 84f1acd1-4e3e-47bf-a09e-c756ebe35855 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19202024-09-16T14:47:03.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 84f1acd1-4e3e-47bf-a09e-c756ebe35855 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19212024-09-16T14:47:03.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 84f1acd1-4e3e-47bf-a09e-c756ebe35855 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19222024-09-16T14:47:04.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = b9aab397-e5fa-4175-833b-92a3bfcd098e roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19232024-09-16T14:47:04.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = b9aab397-e5fa-4175-833b-92a3bfcd098e resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19242024-09-16T14:47:04.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = b9aab397-e5fa-4175-833b-92a3bfcd098e response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19252024-09-16T14:47:05.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6f847e72-b2ed-4c8b-9036-3bbf073712b4 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19262024-09-16T14:47:05.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6f847e72-b2ed-4c8b-9036-3bbf073712b4 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19272024-09-16T14:47:05.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6f847e72-b2ed-4c8b-9036-3bbf073712b4 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19282024-09-16T14:47:05.853ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = 7f254f5c-80d8-4b2d-bd01-1d55733e40a4 response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
19292024-09-16T14:47:06.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 78ef69ad-fd50-4ccb-87cd-8fb123529c80 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19302024-09-16T14:47:06.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 78ef69ad-fd50-4ccb-87cd-8fb123529c80 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19312024-09-16T14:47:06.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 78ef69ad-fd50-4ccb-87cd-8fb123529c80 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19322024-09-16T14:47:07.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 05596935-ea57-491a-badb-46e70997d602 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19332024-09-16T14:47:07.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 05596935-ea57-491a-badb-46e70997d602 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19342024-09-16T14:47:07.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2636 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 05596935-ea57-491a-badb-46e70997d602 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19352024-09-16T14:47:08.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7b65f99d-1c98-44bd-9571-1d7b5a801960 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19362024-09-16T14:47:08.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7b65f99d-1c98-44bd-9571-1d7b5a801960 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19372024-09-16T14:47:08.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7b65f99d-1c98-44bd-9571-1d7b5a801960 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19382024-09-16T14:47:09.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 71a01f97-273c-4ca9-95c5-26f60d4b0b3f roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19392024-09-16T14:47:09.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 71a01f97-273c-4ca9-95c5-26f60d4b0b3f resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19402024-09-16T14:47:09.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 71a01f97-273c-4ca9-95c5-26f60d4b0b3f response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19412024-09-16T14:47:10.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 26a4b3a8-37b2-4b57-8c8f-662c15f2339e roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19422024-09-16T14:47:10.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 26a4b3a8-37b2-4b57-8c8f-662c15f2339e resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19432024-09-16T14:47:10.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1610 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 26a4b3a8-37b2-4b57-8c8f-662c15f2339e response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19442024-09-16T14:47:11.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
19452024-09-16T14:47:11.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19462024-09-16T14:47:11.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
19472024-09-16T14:47:11.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19482024-09-16T14:47:11.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19492024-09-16T14:47:11.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19502024-09-16T14:47:11.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19512024-09-16T14:47:11.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19522024-09-16T14:47:11.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19532024-09-16T14:47:11.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19542024-09-16T14:47:11.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19552024-09-16T14:47:11.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19562024-09-16T14:47:11.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19572024-09-16T14:47:11.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
19582024-09-16T14:47:11.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19592024-09-16T14:47:11.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19602024-09-16T14:47:11.574ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
19612024-09-16T14:47:11.574ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.96197ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
19622024-09-16T14:47:11.587ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19632024-09-16T14:47:11.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19642024-09-16T14:47:11.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.93282ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19652024-09-16T14:47:11.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a0cad225-4d19-47dc-9074-453cd10d4d87 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19662024-09-16T14:47:11.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a0cad225-4d19-47dc-9074-453cd10d4d87 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19672024-09-16T14:47:11.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a0cad225-4d19-47dc-9074-453cd10d4d87 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19682024-09-16T14:47:12.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8b3cba4e-a25f-4115-ada2-31ee4de10daa roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19692024-09-16T14:47:12.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8b3cba4e-a25f-4115-ada2-31ee4de10daa resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19702024-09-16T14:47:12.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8b3cba4e-a25f-4115-ada2-31ee4de10daa response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19712024-09-16T14:47:13.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 81acb684-a4ee-4cae-bf64-b148515195b1 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19722024-09-16T14:47:13.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 81acb684-a4ee-4cae-bf64-b148515195b1 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19732024-09-16T14:47:13.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 81acb684-a4ee-4cae-bf64-b148515195b1 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19742024-09-16T14:47:14.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e956ef18-d433-4b1a-9f78-4b4671e46b41 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19752024-09-16T14:47:14.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e956ef18-d433-4b1a-9f78-4b4671e46b41 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19762024-09-16T14:47:14.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e956ef18-d433-4b1a-9f78-4b4671e46b41 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19772024-09-16T14:47:15.853ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1853 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = 72cde168-0bdb-44e0-97eb-9d6fe9e9f3cf response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
19782024-09-16T14:47:15.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 63e7100c-dd92-4bd4-ae7b-f074a98855c6 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19792024-09-16T14:47:15.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 63e7100c-dd92-4bd4-ae7b-f074a98855c6 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19802024-09-16T14:47:15.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 63e7100c-dd92-4bd4-ae7b-f074a98855c6 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19812024-09-16T14:47:17.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 9b5a658b-e2d1-470e-8d31-21f86320c2f4 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19822024-09-16T14:47:17.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 9b5a658b-e2d1-470e-8d31-21f86320c2f4 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19832024-09-16T14:47:17.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 9b5a658b-e2d1-470e-8d31-21f86320c2f4 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19842024-09-16T14:47:18.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 574203c1-77b3-4833-9f34-a7ac55593bd3 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19852024-09-16T14:47:18.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 574203c1-77b3-4833-9f34-a7ac55593bd3 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19862024-09-16T14:47:18.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 574203c1-77b3-4833-9f34-a7ac55593bd3 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19872024-09-16T14:47:19.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 47d0adf7-f09e-45a1-bd86-d019830c1e22 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19882024-09-16T14:47:19.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 47d0adf7-f09e-45a1-bd86-d019830c1e22 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19892024-09-16T14:47:19.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2516 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 47d0adf7-f09e-45a1-bd86-d019830c1e22 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19902024-09-16T14:47:20.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4a68cd85-ec2b-4449-906b-4abe5085f30b roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19912024-09-16T14:47:20.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4a68cd85-ec2b-4449-906b-4abe5085f30b resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19922024-09-16T14:47:20.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2790 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4a68cd85-ec2b-4449-906b-4abe5085f30b response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19932024-09-16T14:47:21.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6de755a4-7230-4ed5-813d-2c1757bc1f55 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19942024-09-16T14:47:21.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6de755a4-7230-4ed5-813d-2c1757bc1f55 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19952024-09-16T14:47:21.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1845 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6de755a4-7230-4ed5-813d-2c1757bc1f55 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
19962024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
19972024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
19982024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
19992024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20002024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20012024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20022024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
20032024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20042024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
20052024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
20062024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20072024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
20082024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
20092024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20102024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
20112024-09-16T14:47:21.555ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
20122024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
20132024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
20142024-09-16T14:47:21.555ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-16 14:37:21.555330071 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
20152024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
20162024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
20172024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
20182024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20192024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
20202024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
20212024-09-16T14:47:21.555ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2
20222024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
20232024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.26\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2"}
20242024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20252024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
20262024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
20272024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
20282024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
20292024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20302024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
20312024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
20322024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
20332024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20342024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
20352024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
20362024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20372024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20382024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
20392024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20402024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
20412024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
20422024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
20432024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
20442024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
20452024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
20462024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20472024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
20482024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20492024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20502024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
20512024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
20522024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
20532024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
20542024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
20552024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
20562024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20572024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20582024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20592024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20602024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20612024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20622024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
20632024-09-16T14:47:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20642024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
20652024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
20662024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
20672024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20682024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20692024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20702024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20712024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20722024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
20732024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
20742024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
20752024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20762024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20772024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20782024-09-16T14:47:21.556ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("216291e2-64d0-4e57-82ea-84523304c97b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fcbfd0d4-0b48-4392-95df-b0bdb2c97118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fcbfd0d4-0b48-4392-95df-b0bdb2c97118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 24130, tv_nsec: 514827612 } })
20792024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20802024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20812024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20822024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20832024-09-16T14:47:21.556ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0839d410-88e5-4168-91a3-1340a5d7a912.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f93623c-a4f4-43d1-b285-fdbdeccdc7e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fc6cb4c7-5a91-4879-8aba-57c83b2f5553.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fc6cb4c7-5a91-4879-8aba-57c83b2f5553.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 24130, tv_nsec: 514940414 } })
20842024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20852024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20862024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20872024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20882024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20892024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20902024-09-16T14:47:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20912024-09-16T14:47:21.557ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20922024-09-16T14:47:21.558ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
20932024-09-16T14:47:21.558ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.546887ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
20942024-09-16T14:47:21.558ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
20952024-09-16T14:47:21.558ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.343193ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
20962024-09-16T14:47:21.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20972024-09-16T14:47:21.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20982024-09-16T14:47:21.559ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.116478ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20992024-09-16T14:47:21.560ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24130, tv_nsec: 518671295 } })
21002024-09-16T14:47:21.560ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
21012024-09-16T14:47:21.560ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21022024-09-16T14:47:21.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21032024-09-16T14:47:21.561ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
21042024-09-16T14:47:21.561ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21052024-09-16T14:47:21.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21062024-09-16T14:47:21.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21072024-09-16T14:47:21.562ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-16 14:37:21.555330071 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
21082024-09-16T14:47:21.562ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.222868ms iteration = 7 status = {"expiration":"2024-09-16T14:37:21.555330071Z","pruned":[]}
21092024-09-16T14:47:21.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
21102024-09-16T14:47:21.563ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21112024-09-16T14:47:21.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21122024-09-16T14:47:21.564ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24130, tv_nsec: 523472036 } })
21132024-09-16T14:47:21.565ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.841648ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
21142024-09-16T14:47:21.565ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21152024-09-16T14:47:21.565ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
21162024-09-16T14:47:21.566ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21172024-09-16T14:47:21.566ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21182024-09-16T14:47:21.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21192024-09-16T14:47:21.567ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21202024-09-16T14:47:21.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21212024-09-16T14:47:21.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
21222024-09-16T14:47:21.568ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21232024-09-16T14:47:21.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21242024-09-16T14:47:21.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
21252024-09-16T14:47:21.570ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21262024-09-16T14:47:21.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21272024-09-16T14:47:21.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21282024-09-16T14:47:21.572ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21292024-09-16T14:47:21.572ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21302024-09-16T14:47:21.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21312024-09-16T14:47:21.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21322024-09-16T14:47:21.573ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21332024-09-16T14:47:21.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21342024-09-16T14:47:21.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
21352024-09-16T14:47:21.574ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21362024-09-16T14:47:21.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21372024-09-16T14:47:21.580ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21382024-09-16T14:47:21.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
21392024-09-16T14:47:21.583ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21402024-09-16T14:47:21.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21412024-09-16T14:47:21.586ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21422024-09-16T14:47:21.587ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21432024-09-16T14:47:21.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21442024-09-16T14:47:21.588ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21452024-09-16T14:47:21.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21462024-09-16T14:47:21.589ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21472024-09-16T14:47:21.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21482024-09-16T14:47:21.589ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24130, tv_nsec: 548204128 } })
21492024-09-16T14:47:21.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21502024-09-16T14:47:21.591ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
21512024-09-16T14:47:21.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21522024-09-16T14:47:21.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21532024-09-16T14:47:21.592ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21542024-09-16T14:47:21.592ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:539 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
21552024-09-16T14:47:21.592ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 37.607946ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
21562024-09-16T14:47:21.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21572024-09-16T14:47:21.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21582024-09-16T14:47:21.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21592024-09-16T14:47:21.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21602024-09-16T14:47:21.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21612024-09-16T14:47:21.601ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21622024-09-16T14:47:21.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21632024-09-16T14:47:21.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 50.42285ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
21642024-09-16T14:47:21.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
21652024-09-16T14:47:21.606ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21662024-09-16T14:47:21.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21672024-09-16T14:47:21.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21682024-09-16T14:47:21.606ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21692024-09-16T14:47:21.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21702024-09-16T14:47:21.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21712024-09-16T14:47:21.610ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
21722024-09-16T14:47:21.610ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
21732024-09-16T14:47:21.610ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21742024-09-16T14:47:21.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21752024-09-16T14:47:21.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21762024-09-16T14:47:21.613ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21772024-09-16T14:47:21.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21782024-09-16T14:47:21.613ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21792024-09-16T14:47:21.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21802024-09-16T14:47:21.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
21812024-09-16T14:47:21.616ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
21822024-09-16T14:47:21.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
21832024-09-16T14:47:21.617ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
21842024-09-16T14:47:21.617ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
21852024-09-16T14:47:21.617ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 61.599933ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
21862024-09-16T14:47:21.617ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 61.731066ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
21872024-09-16T14:47:21.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
21882024-09-16T14:47:21.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21892024-09-16T14:47:21.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21902024-09-16T14:47:21.621ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21912024-09-16T14:47:21.624ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21922024-09-16T14:47:21.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
21932024-09-16T14:47:21.624ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21942024-09-16T14:47:21.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21952024-09-16T14:47:21.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21962024-09-16T14:47:21.625ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21972024-09-16T14:47:21.626ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
21982024-09-16T14:47:21.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
21992024-09-16T14:47:21.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
22002024-09-16T14:47:21.628ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22012024-09-16T14:47:21.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
22022024-09-16T14:47:21.628ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22032024-09-16T14:47:21.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
22042024-09-16T14:47:21.630ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22052024-09-16T14:47:21.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
22062024-09-16T14:47:21.636ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 80.669387ms iteration = 4 status = {"nsuccess":5}
22072024-09-16T14:47:21.644ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22082024-09-16T14:47:21.645ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
22092024-09-16T14:47:21.645ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
22102024-09-16T14:47:21.645ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
22112024-09-16T14:47:21.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22122024-09-16T14:47:21.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22132024-09-16T14:47:21.645ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 90.323601ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22142024-09-16T14:47:21.647ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
22152024-09-16T14:47:21.647ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.342569ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
22162024-09-16T14:47:21.648ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22172024-09-16T14:47:21.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22182024-09-16T14:47:21.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22192024-09-16T14:47:21.656ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22202024-09-16T14:47:21.657ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22212024-09-16T14:47:21.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22222024-09-16T14:47:21.660ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22232024-09-16T14:47:21.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22242024-09-16T14:47:21.661ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22252024-09-16T14:47:21.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22262024-09-16T14:47:21.663ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
22272024-09-16T14:47:21.663ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
22282024-09-16T14:47:21.663ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22292024-09-16T14:47:21.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22302024-09-16T14:47:21.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f26461d2-04fe-40aa-80c2-1eb0bc461628, lookup_type: ById(f26461d2-04fe-40aa-80c2-1eb0bc461628) } result = Ok(())
22312024-09-16T14:47:21.664ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22322024-09-16T14:47:21.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22332024-09-16T14:47:21.667ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
22342024-09-16T14:47:21.673ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22352024-09-16T14:47:21.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22362024-09-16T14:47:21.680ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 124.833968ms iteration = 13 status = 0
22372024-09-16T14:47:21.680ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22382024-09-16T14:47:21.683ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
22392024-09-16T14:47:21.683ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22402024-09-16T14:47:21.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22412024-09-16T14:47:21.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 128.930566ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
22422024-09-16T14:47:21.687ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22432024-09-16T14:47:21.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22442024-09-16T14:47:21.689ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 133.639816ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
22452024-09-16T14:47:21.689ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
22462024-09-16T14:47:21.690ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
22472024-09-16T14:47:21.690ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
22482024-09-16T14:47:21.690ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 135.343728ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
22492024-09-16T14:47:21.716ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
22502024-09-16T14:47:21.716ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
22512024-09-16T14:47:21.716ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
22522024-09-16T14:47:21.716ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22532024-09-16T14:47:21.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22542024-09-16T14:47:21.723ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
22552024-09-16T14:47:21.723ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:226 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
22562024-09-16T14:47:21.723ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 167.951759ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
22572024-09-16T14:47:21.725ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
22582024-09-16T14:47:21.726ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d70d9c11-14c5-40d0-be17-039af1ae521e dns_zone_name = oxide.test found_so_far = 0 version = 2
22592024-09-16T14:47:21.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22602024-09-16T14:47:21.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22612024-09-16T14:47:21.728ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22622024-09-16T14:47:21.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22632024-09-16T14:47:21.732ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 177.060993ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
22642024-09-16T14:47:21.738ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-16T14:41:19.171997Z, time_modified: 2024-09-16T14:41:19.171997Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2f0f2dc2-cb37-4fec-9d0b-492287602073, db_silo: Silo { identity: SiloIdentity { id: 2f0f2dc2-cb37-4fec-9d0b-492287602073, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-16T14:41:24.495850Z, time_modified: 2024-09-16T14:41:24.495850Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7a1e72c489a058dd07f837cad69c701f6b45e7cf21c6d4f626d443caf9673a83" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2f0f2dc2-cb37-4fec-9d0b-492287602073, db_silo: Silo { identity: SiloIdentity { id: 2f0f2dc2-cb37-4fec-9d0b-492287602073, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-16T14:41:24.495850Z, time_modified: 2024-09-16T14:41:24.495850Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7a1e72c489a058dd07f837cad69c701f6b45e7cf21c6d4f626d443caf9673a83" }] }) }
22652024-09-16T14:47:21.738ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 183.510526ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2f0f2dc2-cb37-4fec-9d0b-492287602073","tls_certs":["7a1e72c489a058dd07f837cad69c701f6b45e7cf21c6d4f626d443caf9673a83"]}},"default_endpoint":{"silo_id":"2f0f2dc2-cb37-4fec-9d0b-492287602073","tls_certs":["7a1e72c489a058dd07f837cad69c701f6b45e7cf21c6d4f626d443caf9673a83"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
22662024-09-16T14:47:21.758ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 zone_address = fd00:1122:3344:101::2
22672024-09-16T14:47:21.758ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22682024-09-16T14:47:21.758ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "70bf3ac2-a0ef-4554-b4d2-9f7f9de269b3", "content-length": "26", "date": "Mon, 16 Sep 2024 14:47:20 GMT"} })
22692024-09-16T14:47:21.758ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22702024-09-16T14:47:21.761ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
22712024-09-16T14:47:21.768ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 212.901085ms iteration = 16 status = {"physical_disks_added":0}
22722024-09-16T14:47:21.809ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
22732024-09-16T14:47:21.809ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22742024-09-16T14:47:21.809ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5c11ba68-02c4-4f2a-b7ea-7f446fa15846", "content-length": "26", "date": "Mon, 16 Sep 2024 14:47:20 GMT"} })
22752024-09-16T14:47:21.809ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22762024-09-16T14:47:21.813ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22772024-09-16T14:47:21.821ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
22782024-09-16T14:47:21.821ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0ec5c09c-91ba-4ff6-975b-d5a42bfec45d", "date": "Mon, 16 Sep 2024 14:47:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22792024-09-16T14:47:21.821ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22802024-09-16T14:47:21.823ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "65c1e8af-ca81-4812-8bb6-7517736c3dc4", "date": "Mon, 16 Sep 2024 14:47:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22812024-09-16T14:47:21.823ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22822024-09-16T14:47:21.824ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22832024-09-16T14:47:21.824ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 269.664847ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
22842024-09-16T14:47:21.849ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
22852024-09-16T14:47:21.855ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
22862024-09-16T14:47:21.855ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22872024-09-16T14:47:21.856ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c1fe240d-90cd-4646-889e-b03bcb5b9f46", "content-length": "26", "date": "Mon, 16 Sep 2024 14:47:20 GMT"} })
22882024-09-16T14:47:21.856ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22892024-09-16T14:47:21.857ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22902024-09-16T14:47:21.912ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22912024-09-16T14:47:21.913ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e88e2ec0-a403-4a91-8aa9-1740af967233", "content-length": "372", "date": "Mon, 16 Sep 2024 14:47:21 GMT"} })
22922024-09-16T14:47:21.913ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22932024-09-16T14:47:21.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22942024-09-16T14:47:21.914ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22952024-09-16T14:47:21.914ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22962024-09-16T14:47:21.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22972024-09-16T14:47:21.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22982024-09-16T14:47:21.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22992024-09-16T14:47:21.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23002024-09-16T14:47:21.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23012024-09-16T14:47:21.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23022024-09-16T14:47:21.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23032024-09-16T14:47:21.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23042024-09-16T14:47:21.920ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d70d9c11-14c5-40d0-be17-039af1ae521e dns_zone_name = oxide.test found_so_far = 1 version = 2
23052024-09-16T14:47:21.920ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
23062024-09-16T14:47:21.920ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-16 14:41:24.562175 UTC dns_group = external generation = 2
23072024-09-16T14:47:21.920ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 364.684396ms iteration = 8 status = {"generation":2}
23082024-09-16T14:47:21.920ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23092024-09-16T14:47:21.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23102024-09-16T14:47:21.923ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23112024-09-16T14:47:21.924ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "97571850-efae-4279-a4dc-2f8662bfb9b1", "date": "Mon, 16 Sep 2024 14:47:21 GMT"} })
23122024-09-16T14:47:21.926ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 370.900125ms iteration = 14 status = {}
23132024-09-16T14:47:21.946ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
23142024-09-16T14:47:21.946ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 01c7aafc-c1b7-42bb-a493-0c643f2e21db dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
23152024-09-16T14:47:21.946ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23162024-09-16T14:47:21.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23172024-09-16T14:47:21.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23182024-09-16T14:47:21.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23192024-09-16T14:47:21.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23202024-09-16T14:47:21.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23212024-09-16T14:47:21.979ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 01c7aafc-c1b7-42bb-a493-0c643f2e21db dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
23222024-09-16T14:47:21.979ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
23232024-09-16T14:47:21.979ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-16 14:41:23.295040 UTC dns_group = internal generation = 1
23242024-09-16T14:47:21.979ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 424.357953ms iteration = 8 status = {"generation":1}
23252024-09-16T14:47:21.990ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 434.971555ms iteration = 13 status = {}
23262024-09-16T14:47:21.999ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23272024-09-16T14:47:21.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23282024-09-16T14:47:22.001ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23292024-09-16T14:47:22.003ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23302024-09-16T14:47:22.003ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23312024-09-16T14:47:22.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23322024-09-16T14:47:22.004ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23332024-09-16T14:47:22.007ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23342024-09-16T14:47:22.007ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23352024-09-16T14:47:22.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23362024-09-16T14:47:22.060ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
23372024-09-16T14:47:22.060ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d8690ab7-3c76-48f0-9a6b-184892ebfd5a", "date": "Mon, 16 Sep 2024 14:47:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23382024-09-16T14:47:22.060ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23392024-09-16T14:47:22.062ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "82c65b2e-c09e-453d-9ae2-cdb83c645157", "date": "Mon, 16 Sep 2024 14:47:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23402024-09-16T14:47:22.062ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23412024-09-16T14:47:22.063ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "413e9ddb-f44d-45a5-8cfb-4863ed792384", "date": "Mon, 16 Sep 2024 14:47:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23422024-09-16T14:47:22.063ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23432024-09-16T14:47:22.065ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23442024-09-16T14:47:22.065ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 510.29265ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
23452024-09-16T14:47:22.076ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
23462024-09-16T14:47:22.077ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2a975cdf-b5a4-4e91-b743-b9d2e3bd33d3", "content-length": "1", "date": "Mon, 16 Sep 2024 14:47:21 GMT"} })
23472024-09-16T14:47:22.078ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23482024-09-16T14:47:22.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23492024-09-16T14:47:22.081ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 525.847516ms iteration = 13 status = null
23502024-09-16T14:47:22.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23512024-09-16T14:47:22.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23522024-09-16T14:47:22.095ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 94d6770e-63ed-455d-aa9f-8ad47c66c84e, rack_id: 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bc13c6ca-2923-40a0-a45c-bfa5d94842d2) } rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0
23532024-09-16T14:47:22.095ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23542024-09-16T14:47:22.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23552024-09-16T14:47:22.113ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
23562024-09-16T14:47:22.113ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "65830d21-5b44-4b05-94c5-20787b67f5da", "content-length": "691", "date": "Mon, 16 Sep 2024 14:47:21 GMT"} })
23572024-09-16T14:47:22.113ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
23582024-09-16T14:47:22.113ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
23592024-09-16T14:47:22.113ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
23602024-09-16T14:47:22.114ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 559.403495ms iteration = 13 status = {}
23612024-09-16T14:47:22.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c945cbbe-2576-4c05-90f9-6496fc687650 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
23622024-09-16T14:47:22.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c945cbbe-2576-4c05-90f9-6496fc687650 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
23632024-09-16T14:47:22.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c945cbbe-2576-4c05-90f9-6496fc687650 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
23642024-09-16T14:47:22.122ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
23652024-09-16T14:47:22.122ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ddc68acc-94a3-4186-bc14-2f154b3736de", "content-length": "121", "date": "Mon, 16 Sep 2024 14:47:21 GMT"} })
23662024-09-16T14:47:22.122ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
23672024-09-16T14:47:22.122ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bc13c6ca-2923-40a0-a45c-bfa5d94842d2
23682024-09-16T14:47:22.122ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
23692024-09-16T14:47:22.122ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
23702024-09-16T14:47:22.122ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {}
23712024-09-16T14:47:22.122ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {}
23722024-09-16T14:47:22.122ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
23732024-09-16T14:47:22.122ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23742024-09-16T14:47:22.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23752024-09-16T14:47:22.124ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
23762024-09-16T14:47:22.124ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "837a66a4-a149-476d-8bf5-b84fb1548bd2", "content-length": "2", "date": "Mon, 16 Sep 2024 14:47:21 GMT"} })
23772024-09-16T14:47:22.124ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
23782024-09-16T14:47:22.124ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ff31ad2f-44ff-4239-975f-72c0a4ac5d78", "content-length": "52", "date": "Mon, 16 Sep 2024 14:47:21 GMT"} })
23792024-09-16T14:47:22.124ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0
23802024-09-16T14:47:22.124ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
23812024-09-16T14:47:22.284ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "80763f53-e96e-40d4-8f6a-e8aed096a8d1", "date": "Mon, 16 Sep 2024 14:47:21 GMT"} })
23822024-09-16T14:47:22.284ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch = Switch0
23832024-09-16T14:47:22.284ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
23842024-09-16T14:47:22.285ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d1421292-a5ec-48c5-b5a1-722868281672", "content-length": "667", "date": "Mon, 16 Sep 2024 14:47:21 GMT"} })
23852024-09-16T14:47:22.285ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23862024-09-16T14:47:22.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23872024-09-16T14:47:22.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23882024-09-16T14:47:22.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23892024-09-16T14:47:22.292ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23902024-09-16T14:47:22.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23912024-09-16T14:47:22.294ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23922024-09-16T14:47:22.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23932024-09-16T14:47:22.301ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 746.351796ms iteration = 13 status = {}
23942024-09-16T14:47:23.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 498d6dea-b714-469f-b0cd-cba2a9ad3685 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
23952024-09-16T14:47:23.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 498d6dea-b714-469f-b0cd-cba2a9ad3685 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
23962024-09-16T14:47:23.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 498d6dea-b714-469f-b0cd-cba2a9ad3685 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
23972024-09-16T14:47:24.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 89e8a4e1-a739-46d1-83cc-9e4bf7257cf9 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
23982024-09-16T14:47:24.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 89e8a4e1-a739-46d1-83cc-9e4bf7257cf9 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
23992024-09-16T14:47:24.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 89e8a4e1-a739-46d1-83cc-9e4bf7257cf9 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24002024-09-16T14:47:25.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 824cf3e3-afef-4fd3-8f68-2034f1679297 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24012024-09-16T14:47:25.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 824cf3e3-afef-4fd3-8f68-2034f1679297 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24022024-09-16T14:47:25.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2741 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 824cf3e3-afef-4fd3-8f68-2034f1679297 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24032024-09-16T14:47:25.852ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1577 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = 5dc62a9e-c90b-4357-8229-e6fb896435f1 response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
24042024-09-16T14:47:26.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 2b6c0fc9-4910-435b-b9ca-48784128e0a2 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24052024-09-16T14:47:26.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 2b6c0fc9-4910-435b-b9ca-48784128e0a2 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24062024-09-16T14:47:26.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1694 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 2b6c0fc9-4910-435b-b9ca-48784128e0a2 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24072024-09-16T14:47:27.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 87fda3a2-c759-4a08-811a-b847b9da6439 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24082024-09-16T14:47:27.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 87fda3a2-c759-4a08-811a-b847b9da6439 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24092024-09-16T14:47:27.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 87fda3a2-c759-4a08-811a-b847b9da6439 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24102024-09-16T14:47:28.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 575f75cf-84e8-4b49-8315-da68f7e2b030 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24112024-09-16T14:47:28.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 575f75cf-84e8-4b49-8315-da68f7e2b030 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24122024-09-16T14:47:28.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 575f75cf-84e8-4b49-8315-da68f7e2b030 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24132024-09-16T14:47:29.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6470971d-cea4-491e-a7da-b555d0b2e2f4 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24142024-09-16T14:47:29.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6470971d-cea4-491e-a7da-b555d0b2e2f4 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24152024-09-16T14:47:29.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6470971d-cea4-491e-a7da-b555d0b2e2f4 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24162024-09-16T14:47:30.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = b43adc62-d7df-41b2-9742-2cbd90fbd539 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24172024-09-16T14:47:30.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = b43adc62-d7df-41b2-9742-2cbd90fbd539 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24182024-09-16T14:47:30.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = b43adc62-d7df-41b2-9742-2cbd90fbd539 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24192024-09-16T14:47:30.557ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:38600
24202024-09-16T14:47:30.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38600 req_id = 5917c96e-1e17-4526-bf44-795a9f40d6a7 roles = RoleSet { roles: {} } uri = /metrics/producers
24212024-09-16T14:47:30.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38600 req_id = 5917c96e-1e17-4526-bf44-795a9f40d6a7 resource = Database result = Ok(()) uri = /metrics/producers
24222024-09-16T14:47:30.591ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d9cae32d-8e84-4f97-9d87-f815a97563b7
24232024-09-16T14:47:30.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38600 req_id = 5917c96e-1e17-4526-bf44-795a9f40d6a7 roles = RoleSet { roles: {} } uri = /metrics/producers
24242024-09-16T14:47:30.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38600 req_id = 5917c96e-1e17-4526-bf44-795a9f40d6a7 resource = Database result = Ok(()) uri = /metrics/producers
24252024-09-16T14:47:30.624ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 uri = http://[fd00:1122:3344:101::d]:12223/producers
24262024-09-16T14:47:30.625ZDEBGnexus: client response oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "719c273c-8d2c-4da1-91c0-bc628cf83400", "date": "Mon, 16 Sep 2024 14:47:30 GMT"} })
24272024-09-16T14:47:30.625ZINFOnexus: assigned collector to new producer collector_id = d9cae32d-8e84-4f97-9d87-f815a97563b7 file = nexus/src/app/oximeter.rs:125 producer_id = 881d88a2-03c8-4c19-b7d6-7d5febb79625
24282024-09-16T14:47:30.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 68811 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38600 req_id = 5917c96e-1e17-4526-bf44-795a9f40d6a7 response_code = 201 uri = /metrics/producers
24292024-09-16T14:47:31.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = ace5f1ba-8624-436a-a0b0-317550cab75e roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24302024-09-16T14:47:31.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = ace5f1ba-8624-436a-a0b0-317550cab75e resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24312024-09-16T14:47:31.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = ace5f1ba-8624-436a-a0b0-317550cab75e response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24322024-09-16T14:47:31.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
24332024-09-16T14:47:31.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
24342024-09-16T14:47:31.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24352024-09-16T14:47:31.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24362024-09-16T14:47:31.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24372024-09-16T14:47:31.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24382024-09-16T14:47:31.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24392024-09-16T14:47:31.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24402024-09-16T14:47:31.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24412024-09-16T14:47:31.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24422024-09-16T14:47:31.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24432024-09-16T14:47:31.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24442024-09-16T14:47:31.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24452024-09-16T14:47:31.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
24462024-09-16T14:47:31.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24472024-09-16T14:47:31.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24482024-09-16T14:47:31.574ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
24492024-09-16T14:47:31.574ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.602693ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
24502024-09-16T14:47:31.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24512024-09-16T14:47:31.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24522024-09-16T14:47:31.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.518496ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24532024-09-16T14:47:32.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e242805b-b896-4566-ab12-0e63353c8663 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24542024-09-16T14:47:32.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e242805b-b896-4566-ab12-0e63353c8663 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24552024-09-16T14:47:32.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e242805b-b896-4566-ab12-0e63353c8663 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24562024-09-16T14:47:33.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8bdb072c-f77a-4dc3-bc0b-90582ece2d81 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24572024-09-16T14:47:33.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8bdb072c-f77a-4dc3-bc0b-90582ece2d81 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24582024-09-16T14:47:33.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8bdb072c-f77a-4dc3-bc0b-90582ece2d81 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24592024-09-16T14:47:34.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d9992e98-d811-46a8-acec-77b4ab8bcf21 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24602024-09-16T14:47:34.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d9992e98-d811-46a8-acec-77b4ab8bcf21 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24612024-09-16T14:47:34.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2648 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d9992e98-d811-46a8-acec-77b4ab8bcf21 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24622024-09-16T14:47:34.807ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:35748
24632024-09-16T14:47:34.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35748 req_id = 929d7564-332c-41af-a054-b9a9d9a44328 roles = RoleSet { roles: {} } uri = /metrics/producers
24642024-09-16T14:47:34.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35748 req_id = 929d7564-332c-41af-a054-b9a9d9a44328 resource = Database result = Ok(()) uri = /metrics/producers
24652024-09-16T14:47:34.842ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d9cae32d-8e84-4f97-9d87-f815a97563b7
24662024-09-16T14:47:34.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35748 req_id = 929d7564-332c-41af-a054-b9a9d9a44328 roles = RoleSet { roles: {} } uri = /metrics/producers
24672024-09-16T14:47:34.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35748 req_id = 929d7564-332c-41af-a054-b9a9d9a44328 resource = Database result = Ok(()) uri = /metrics/producers
24682024-09-16T14:47:34.851ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 uri = http://[fd00:1122:3344:101::d]:12223/producers
24692024-09-16T14:47:34.852ZDEBGnexus: client response oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bb545ffa-ff5e-45ef-b539-d45f92ad5fe8", "date": "Mon, 16 Sep 2024 14:47:34 GMT"} })
24702024-09-16T14:47:34.852ZINFOnexus: assigned collector to new producer collector_id = d9cae32d-8e84-4f97-9d87-f815a97563b7 file = nexus/src/app/oximeter.rs:125 producer_id = ab94c385-d2ae-4032-9ac3-7db416af9813
24712024-09-16T14:47:34.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 45932 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35748 req_id = 929d7564-332c-41af-a054-b9a9d9a44328 response_code = 201 uri = /metrics/producers
24722024-09-16T14:47:35.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 87f20365-4b2d-4447-a732-dcaa1910452b roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24732024-09-16T14:47:35.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 87f20365-4b2d-4447-a732-dcaa1910452b resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24742024-09-16T14:47:35.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 87f20365-4b2d-4447-a732-dcaa1910452b response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24752024-09-16T14:47:35.853ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1900 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = e08090fa-4db5-46c9-b888-aa908db2d9ba response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
24762024-09-16T14:47:36.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5b52b243-0399-49af-8c6e-e5d0d96b3595 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24772024-09-16T14:47:36.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5b52b243-0399-49af-8c6e-e5d0d96b3595 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24782024-09-16T14:47:36.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5b52b243-0399-49af-8c6e-e5d0d96b3595 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24792024-09-16T14:47:37.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3b638bca-544a-4141-b085-13cb2701b725 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24802024-09-16T14:47:37.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3b638bca-544a-4141-b085-13cb2701b725 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24812024-09-16T14:47:37.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3b638bca-544a-4141-b085-13cb2701b725 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24822024-09-16T14:47:38.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7be92c06-0349-4f26-ad58-8e79b722fdd4 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24832024-09-16T14:47:38.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7be92c06-0349-4f26-ad58-8e79b722fdd4 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24842024-09-16T14:47:38.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7be92c06-0349-4f26-ad58-8e79b722fdd4 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24852024-09-16T14:47:39.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d252f7b9-db46-4275-8a0a-442788024f25 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24862024-09-16T14:47:39.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d252f7b9-db46-4275-8a0a-442788024f25 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24872024-09-16T14:47:39.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d252f7b9-db46-4275-8a0a-442788024f25 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24882024-09-16T14:47:40.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c7bd5dd3-b3a6-4ae5-8a0b-a35eacfa5b72 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24892024-09-16T14:47:40.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c7bd5dd3-b3a6-4ae5-8a0b-a35eacfa5b72 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24902024-09-16T14:47:40.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c7bd5dd3-b3a6-4ae5-8a0b-a35eacfa5b72 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
24912024-09-16T14:47:41.399ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1984 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f3dd3c9e-00a3-4c70-9bbd-f5d062443413 remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f8aaba60-27cc-44df-b047-ace75a4a1a56 uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-09-16T14:47:41.388431652Z }
24922024-09-16T14:47:41.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f8aaba60-27cc-44df-b047-ace75a4a1a56 roles = RoleSet { roles: {} } uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
24932024-09-16T14:47:41.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f8aaba60-27cc-44df-b047-ace75a4a1a56 resource = Database result = Ok(()) uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
24942024-09-16T14:47:41.425ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:44554
24952024-09-16T14:47:41.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:44554 req_id = 5ad6aebd-f8de-4666-922e-6437a616d818 roles = RoleSet { roles: {} } uri = /metrics/producers
24962024-09-16T14:47:41.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:44554 req_id = 5ad6aebd-f8de-4666-922e-6437a616d818 resource = Database result = Ok(()) uri = /metrics/producers
24972024-09-16T14:47:41.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 55944 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f8aaba60-27cc-44df-b047-ace75a4a1a56 response_code = 204 uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
24982024-09-16T14:47:41.446ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1984 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f3dd3c9e-00a3-4c70-9bbd-f5d062443413 remote_addr = [fd00:1122:3344:101::1]:45812 req_id = eda1502d-b758-487e-9dce-785b242905d3 uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-09-16T14:47:41.446097901Z }
24992024-09-16T14:47:41.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = eda1502d-b758-487e-9dce-785b242905d3 roles = RoleSet { roles: {} } uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
25002024-09-16T14:47:41.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = eda1502d-b758-487e-9dce-785b242905d3 resource = Database result = Ok(()) uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
25012024-09-16T14:47:41.459ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d9cae32d-8e84-4f97-9d87-f815a97563b7
25022024-09-16T14:47:41.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:44554 req_id = 5ad6aebd-f8de-4666-922e-6437a616d818 roles = RoleSet { roles: {} } uri = /metrics/producers
25032024-09-16T14:47:41.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:44554 req_id = 5ad6aebd-f8de-4666-922e-6437a616d818 resource = Database result = Ok(()) uri = /metrics/producers
25042024-09-16T14:47:41.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 33128 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = eda1502d-b758-487e-9dce-785b242905d3 response_code = 204 uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
25052024-09-16T14:47:41.487ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 uri = http://[fd00:1122:3344:101::d]:12223/producers
25062024-09-16T14:47:41.488ZDEBGnexus: client response oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "99f1818f-1f3b-453d-9214-6fb728a81f17", "date": "Mon, 16 Sep 2024 14:47:41 GMT"} })
25072024-09-16T14:47:41.488ZINFOnexus: assigned collector to new producer collector_id = d9cae32d-8e84-4f97-9d87-f815a97563b7 file = nexus/src/app/oximeter.rs:125 producer_id = f84e45da-7f43-4901-939e-774632378ef9
25082024-09-16T14:47:41.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 64958 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:44554 req_id = 5ad6aebd-f8de-4666-922e-6437a616d818 response_code = 201 uri = /metrics/producers
25092024-09-16T14:47:41.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
25102024-09-16T14:47:41.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25112024-09-16T14:47:41.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
25122024-09-16T14:47:41.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25132024-09-16T14:47:41.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25142024-09-16T14:47:41.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25152024-09-16T14:47:41.556ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25162024-09-16T14:47:41.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25172024-09-16T14:47:41.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25182024-09-16T14:47:41.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25192024-09-16T14:47:41.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25202024-09-16T14:47:41.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25212024-09-16T14:47:41.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25222024-09-16T14:47:41.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25232024-09-16T14:47:41.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6766ae38-b98c-4cc8-8f13-59215d3d3508 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25242024-09-16T14:47:41.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6766ae38-b98c-4cc8-8f13-59215d3d3508 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25252024-09-16T14:47:41.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6766ae38-b98c-4cc8-8f13-59215d3d3508 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25262024-09-16T14:47:41.585ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.803807ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25272024-09-16T14:47:41.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25282024-09-16T14:47:41.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
25292024-09-16T14:47:41.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25302024-09-16T14:47:41.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25312024-09-16T14:47:41.602ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
25322024-09-16T14:47:41.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.841071ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
25332024-09-16T14:47:42.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c67b4d88-2788-4043-9dc3-7c9fe08a6998 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25342024-09-16T14:47:42.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c67b4d88-2788-4043-9dc3-7c9fe08a6998 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25352024-09-16T14:47:42.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2088 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c67b4d88-2788-4043-9dc3-7c9fe08a6998 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25362024-09-16T14:47:43.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 94e5ec77-c7e7-4275-a39c-e021e5f8e158 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25372024-09-16T14:47:43.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 94e5ec77-c7e7-4275-a39c-e021e5f8e158 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25382024-09-16T14:47:43.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2871 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 94e5ec77-c7e7-4275-a39c-e021e5f8e158 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25392024-09-16T14:47:44.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a623dea8-166f-4124-a5bc-26e2558fb241 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25402024-09-16T14:47:44.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a623dea8-166f-4124-a5bc-26e2558fb241 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25412024-09-16T14:47:44.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a623dea8-166f-4124-a5bc-26e2558fb241 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25422024-09-16T14:47:45.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 10713b1a-c0f2-4483-8ff9-77b820f7b020 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25432024-09-16T14:47:45.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 10713b1a-c0f2-4483-8ff9-77b820f7b020 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25442024-09-16T14:47:45.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 10713b1a-c0f2-4483-8ff9-77b820f7b020 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25452024-09-16T14:47:45.851ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1387 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = 2498d670-bcff-48db-b272-ca3cb75bc39a response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
25462024-09-16T14:47:46.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3bb985af-bcee-4ef7-bfd5-ea38b58c730f roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25472024-09-16T14:47:46.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3bb985af-bcee-4ef7-bfd5-ea38b58c730f resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25482024-09-16T14:47:46.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2632 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3bb985af-bcee-4ef7-bfd5-ea38b58c730f response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25492024-09-16T14:47:47.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a0d23f00-7689-47dd-9707-0398a28c9e48 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25502024-09-16T14:47:47.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a0d23f00-7689-47dd-9707-0398a28c9e48 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25512024-09-16T14:47:47.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a0d23f00-7689-47dd-9707-0398a28c9e48 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25522024-09-16T14:47:48.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = adb58618-8a87-44a1-b06e-db4a7beefdd6 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25532024-09-16T14:47:48.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = adb58618-8a87-44a1-b06e-db4a7beefdd6 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25542024-09-16T14:47:48.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2867 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = adb58618-8a87-44a1-b06e-db4a7beefdd6 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25552024-09-16T14:47:49.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = b55b3a5d-8342-4a1e-aeb7-276e962e56df roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25562024-09-16T14:47:49.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = b55b3a5d-8342-4a1e-aeb7-276e962e56df resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25572024-09-16T14:47:49.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = b55b3a5d-8342-4a1e-aeb7-276e962e56df response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25582024-09-16T14:47:50.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 0b0671cf-d577-46ad-9925-e22ba40eeec5 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25592024-09-16T14:47:50.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 0b0671cf-d577-46ad-9925-e22ba40eeec5 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25602024-09-16T14:47:50.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 0b0671cf-d577-46ad-9925-e22ba40eeec5 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
25612024-09-16T14:47:51.554ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
25622024-09-16T14:47:51.554ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
25632024-09-16T14:47:51.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25642024-09-16T14:47:51.554ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25652024-09-16T14:47:51.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
25662024-09-16T14:47:51.554ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
25672024-09-16T14:47:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25682024-09-16T14:47:51.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25692024-09-16T14:47:51.554ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
25702024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25712024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
25722024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25732024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
25742024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
25752024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
25762024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
25772024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
25782024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
25792024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25802024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25812024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
25822024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
25832024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25842024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
25852024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25862024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
25872024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
25882024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25892024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
25902024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
25912024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25922024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
25932024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25942024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
25952024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25962024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25972024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25982024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
25992024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26002024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
26012024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26022024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26032024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26042024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26052024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26062024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26072024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26082024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
26092024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26102024-09-16T14:47:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26112024-09-16T14:47:51.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26122024-09-16T14:47:51.558ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26132024-09-16T14:47:51.559ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.972976ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
26142024-09-16T14:47:51.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26152024-09-16T14:47:51.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
26162024-09-16T14:47:51.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26172024-09-16T14:47:51.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26182024-09-16T14:47:51.560ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24160, tv_nsec: 519349198 } })
26192024-09-16T14:47:51.561ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
26202024-09-16T14:47:51.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26212024-09-16T14:47:51.561ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26222024-09-16T14:47:51.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26232024-09-16T14:47:51.561ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26242024-09-16T14:47:51.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26252024-09-16T14:47:51.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26262024-09-16T14:47:51.565ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24160, tv_nsec: 524504876 } })
26272024-09-16T14:47:51.566ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26282024-09-16T14:47:51.566ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
26292024-09-16T14:47:51.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26302024-09-16T14:47:51.568ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26312024-09-16T14:47:51.568ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26322024-09-16T14:47:51.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26332024-09-16T14:47:51.571ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26342024-09-16T14:47:51.571ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26352024-09-16T14:47:51.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26362024-09-16T14:47:51.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26372024-09-16T14:47:51.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.989022ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
26382024-09-16T14:47:51.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26392024-09-16T14:47:51.606ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
26402024-09-16T14:47:51.606ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
26412024-09-16T14:47:51.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26422024-09-16T14:47:51.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26432024-09-16T14:47:51.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.165711ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
26442024-09-16T14:47:51.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26452024-09-16T14:47:51.612ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26462024-09-16T14:47:51.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26472024-09-16T14:47:51.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26482024-09-16T14:47:51.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26492024-09-16T14:47:51.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26502024-09-16T14:47:51.615ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26512024-09-16T14:47:51.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26522024-09-16T14:47:51.615ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26532024-09-16T14:47:51.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26542024-09-16T14:47:51.616ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26552024-09-16T14:47:51.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26562024-09-16T14:47:51.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
26572024-09-16T14:47:51.617ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26582024-09-16T14:47:51.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26592024-09-16T14:47:51.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26602024-09-16T14:47:51.618ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26612024-09-16T14:47:51.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26622024-09-16T14:47:51.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26632024-09-16T14:47:51.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26642024-09-16T14:47:51.620ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 65.734562ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
26652024-09-16T14:47:51.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26662024-09-16T14:47:51.622ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24160, tv_nsec: 581454641 } })
26672024-09-16T14:47:51.623ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
26682024-09-16T14:47:51.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
26692024-09-16T14:47:51.625ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26702024-09-16T14:47:51.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26712024-09-16T14:47:51.630ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26722024-09-16T14:47:51.632ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26732024-09-16T14:47:51.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26742024-09-16T14:47:51.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
26752024-09-16T14:47:51.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26762024-09-16T14:47:51.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26772024-09-16T14:47:51.636ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
26782024-09-16T14:47:51.636ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26792024-09-16T14:47:51.636ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3ae0d7e7-ae9b-449c-bebc-0241796d8788", "content-length": "26", "date": "Mon, 16 Sep 2024 14:47:50 GMT"} })
26802024-09-16T14:47:51.636ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26812024-09-16T14:47:51.636ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26822024-09-16T14:47:51.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26832024-09-16T14:47:51.638ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
26842024-09-16T14:47:51.638ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 83.304407ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
26852024-09-16T14:47:51.638ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26862024-09-16T14:47:51.647ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
26872024-09-16T14:47:51.647ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26882024-09-16T14:47:51.648ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a34d8067-bce8-43f8-8ef6-f429d435ccd6", "content-length": "26", "date": "Mon, 16 Sep 2024 14:47:50 GMT"} })
26892024-09-16T14:47:51.648ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26902024-09-16T14:47:51.652ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26912024-09-16T14:47:51.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 104.888547ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26922024-09-16T14:47:51.662ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 106.971258ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
26932024-09-16T14:47:51.663ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
26942024-09-16T14:47:51.663ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
26952024-09-16T14:47:51.663ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26962024-09-16T14:47:51.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26972024-09-16T14:47:51.685ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 130.493325ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
26982024-09-16T14:47:51.729ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 174.107187ms iteration = 17 status = {"physical_disks_added":0}
26992024-09-16T14:47:51.734ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27002024-09-16T14:47:51.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27012024-09-16T14:47:51.771ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413/state
27022024-09-16T14:47:51.781ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
27032024-09-16T14:47:51.781ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fa52c754-c3fd-455d-9a5a-869f558dcbaa", "content-length": "1", "date": "Mon, 16 Sep 2024 14:47:50 GMT"} })
27042024-09-16T14:47:51.782ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27052024-09-16T14:47:51.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27062024-09-16T14:47:51.785ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 230.100343ms iteration = 14 status = null
27072024-09-16T14:47:51.788ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27082024-09-16T14:47:51.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27092024-09-16T14:47:51.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27102024-09-16T14:47:51.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27112024-09-16T14:47:51.797ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
27122024-09-16T14:47:51.797ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:226 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
27132024-09-16T14:47:51.797ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 242.705323ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
27142024-09-16T14:47:51.797ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27152024-09-16T14:47:51.799ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27162024-09-16T14:47:51.799ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27172024-09-16T14:47:51.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27182024-09-16T14:47:51.800ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = instance_watcher result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413/state", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d52cb79a-a1a8-49a3-beda-7146d52b667d", "content-length": "130", "date": "Mon, 16 Sep 2024 14:47:51 GMT"} })
27192024-09-16T14:47:51.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27202024-09-16T14:47:51.803ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = f84e45da-7f43-4901-939e-774632378ef9 sled_id = f26461d2-04fe-40aa-80c2-1eb0bc461628 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-09-16T14:47:41.446097901Z }, migration_in: None, migration_out: None } vmm_id = f3dd3c9e-00a3-4c70-9bbd-f5d062443413
27212024-09-16T14:47:51.803ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:1984 instance_id = f84e45da-7f43-4901-939e-774632378ef9 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f3dd3c9e-00a3-4c70-9bbd-f5d062443413 sled_id = f26461d2-04fe-40aa-80c2-1eb0bc461628 vmm_id = f3dd3c9e-00a3-4c70-9bbd-f5d062443413 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-09-16T14:47:41.446097901Z }
27222024-09-16T14:47:51.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = f84e45da-7f43-4901-939e-774632378ef9 roles = RoleSet { roles: {} } sled_id = f26461d2-04fe-40aa-80c2-1eb0bc461628 vmm_id = f3dd3c9e-00a3-4c70-9bbd-f5d062443413
27232024-09-16T14:47:51.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = f84e45da-7f43-4901-939e-774632378ef9 resource = Database result = Ok(()) sled_id = f26461d2-04fe-40aa-80c2-1eb0bc461628 vmm_id = f3dd3c9e-00a3-4c70-9bbd-f5d062443413
27242024-09-16T14:47:51.803ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27252024-09-16T14:47:51.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27262024-09-16T14:47:51.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27272024-09-16T14:47:51.805ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27282024-09-16T14:47:51.806ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "aa882181-a50b-418e-96e5-d375188146f0", "content-length": "585", "date": "Mon, 16 Sep 2024 14:47:51 GMT"} })
27292024-09-16T14:47:51.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27302024-09-16T14:47:51.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27312024-09-16T14:47:51.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27322024-09-16T14:47:51.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27332024-09-16T14:47:51.811ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27342024-09-16T14:47:51.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27352024-09-16T14:47:51.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27362024-09-16T14:47:51.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27372024-09-16T14:47:51.817ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27382024-09-16T14:47:51.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27392024-09-16T14:47:51.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d11e4ae5-ad03-43bd-b92d-472899a51b5d roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
27402024-09-16T14:47:51.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d11e4ae5-ad03-43bd-b92d-472899a51b5d resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
27412024-09-16T14:47:51.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27422024-09-16T14:47:51.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d11e4ae5-ad03-43bd-b92d-472899a51b5d response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
27432024-09-16T14:47:51.821ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27442024-09-16T14:47:51.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27452024-09-16T14:47:51.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f26461d2-04fe-40aa-80c2-1eb0bc461628, lookup_type: ById(f26461d2-04fe-40aa-80c2-1eb0bc461628) } result = Ok(())
27462024-09-16T14:47:51.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27472024-09-16T14:47:51.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27482024-09-16T14:47:51.824ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27492024-09-16T14:47:51.824ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 269.228238ms iteration = 14 status = 0
27502024-09-16T14:47:51.830ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "226bbe94-9259-4a73-b968-d80362160ff8", "date": "Mon, 16 Sep 2024 14:47:51 GMT"} })
27512024-09-16T14:47:51.832ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 277.305062ms iteration = 15 status = {}
27522024-09-16T14:47:51.835ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:539 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
27532024-09-16T14:47:51.837ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 282.299677ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
27542024-09-16T14:47:51.848ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 zone_address = fd00:1122:3344:101::2
27552024-09-16T14:47:51.848ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27562024-09-16T14:47:51.848ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 293.48854ms iteration = 14 status = {}
27572024-09-16T14:47:51.848ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "34224561-98c7-4e78-944d-bed0fd6aabd9", "content-length": "26", "date": "Mon, 16 Sep 2024 14:47:50 GMT"} })
27582024-09-16T14:47:51.848ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27592024-09-16T14:47:51.850ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
27602024-09-16T14:47:51.899ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
27612024-09-16T14:47:51.899ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5aaba021-83d8-4532-83af-7f8fd0d830a6", "content-length": "811", "date": "Mon, 16 Sep 2024 14:47:51 GMT"} })
27622024-09-16T14:47:51.899ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(12717777) }} sled = sock
27632024-09-16T14:47:51.899ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
27642024-09-16T14:47:51.899ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
27652024-09-16T14:47:51.901ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 347.061831ms iteration = 14 status = {}
27662024-09-16T14:47:51.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27672024-09-16T14:47:51.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27682024-09-16T14:47:51.953ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 94d6770e-63ed-455d-aa9f-8ad47c66c84e, rack_id: 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bc13c6ca-2923-40a0-a45c-bfa5d94842d2) } rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0
27692024-09-16T14:47:51.953ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27702024-09-16T14:47:51.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27712024-09-16T14:47:51.961ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
27722024-09-16T14:47:51.962ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e7a5c1d6-8c3d-44fb-b30b-f9fa8bd3a0eb", "content-length": "121", "date": "Mon, 16 Sep 2024 14:47:50 GMT"} })
27732024-09-16T14:47:51.962ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
27742024-09-16T14:47:51.962ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bc13c6ca-2923-40a0-a45c-bfa5d94842d2
27752024-09-16T14:47:51.962ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27762024-09-16T14:47:51.962ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27772024-09-16T14:47:51.962ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {}
27782024-09-16T14:47:51.962ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {}
27792024-09-16T14:47:51.962ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
27802024-09-16T14:47:51.962ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27812024-09-16T14:47:51.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27822024-09-16T14:47:51.964ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
27832024-09-16T14:47:51.964ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cbbb8444-9e0e-42ee-982e-2628ddc4fb1c", "content-length": "2", "date": "Mon, 16 Sep 2024 14:47:50 GMT"} })
27842024-09-16T14:47:51.964ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
27852024-09-16T14:47:51.964ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "39f86d4b-475d-4976-a321-d4597fbbc6d0", "content-length": "52", "date": "Mon, 16 Sep 2024 14:47:50 GMT"} })
27862024-09-16T14:47:51.964ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0
27872024-09-16T14:47:51.964ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27882024-09-16T14:47:52.063ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "14d7788b-39f6-48ee-93fc-7402e2d8b99b", "date": "Mon, 16 Sep 2024 14:47:51 GMT"} })
27892024-09-16T14:47:52.063ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch = Switch0
27902024-09-16T14:47:52.063ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27912024-09-16T14:47:52.154ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1ffc1c24-7095-4238-a551-8191cbc802ba", "content-length": "667", "date": "Mon, 16 Sep 2024 14:47:51 GMT"} })
27922024-09-16T14:47:52.154ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27932024-09-16T14:47:52.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27942024-09-16T14:47:52.158ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27952024-09-16T14:47:52.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27962024-09-16T14:47:52.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27972024-09-16T14:47:52.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27982024-09-16T14:47:52.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27992024-09-16T14:47:52.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28002024-09-16T14:47:52.172ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 617.040242ms iteration = 14 status = {}
28012024-09-16T14:47:52.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 67f61fc5-530a-4b57-8340-3316e35f58e4 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
28022024-09-16T14:47:52.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 67f61fc5-530a-4b57-8340-3316e35f58e4 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
28032024-09-16T14:47:52.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 67f61fc5-530a-4b57-8340-3316e35f58e4 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
28042024-09-16T14:47:53.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = bf659c23-38a8-4d33-b32f-ee11a4c8fa57 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
28052024-09-16T14:47:53.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = bf659c23-38a8-4d33-b32f-ee11a4c8fa57 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
28062024-09-16T14:47:53.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2666 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = bf659c23-38a8-4d33-b32f-ee11a4c8fa57 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
28072024-09-16T14:47:54.780ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1984 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f3dd3c9e-00a3-4c70-9bbd-f5d062443413 remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e36e682c-b42e-4293-a717-a6534c72e169 uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-09-16T14:47:54.780280627Z }
28082024-09-16T14:47:54.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e36e682c-b42e-4293-a717-a6534c72e169 roles = RoleSet { roles: {} } uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28092024-09-16T14:47:54.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e36e682c-b42e-4293-a717-a6534c72e169 resource = Database result = Ok(()) uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28102024-09-16T14:47:54.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 11709 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e36e682c-b42e-4293-a717-a6534c72e169 response_code = 204 uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28112024-09-16T14:47:54.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a01c943a-7842-4f6f-b7bc-20a32877ea68 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
28122024-09-16T14:47:54.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a01c943a-7842-4f6f-b7bc-20a32877ea68 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
28132024-09-16T14:47:54.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a01c943a-7842-4f6f-b7bc-20a32877ea68 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
28142024-09-16T14:47:55.852ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1493 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = f9ad62da-4501-4aea-b571-e688d7f6c2b9 response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
28152024-09-16T14:47:55.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 990d63c0-5ef3-403b-a66f-617d14f197ed roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
28162024-09-16T14:47:55.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 990d63c0-5ef3-403b-a66f-617d14f197ed resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
28172024-09-16T14:47:55.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2793 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 990d63c0-5ef3-403b-a66f-617d14f197ed response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
28182024-09-16T14:47:56.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 70a9dad9-64d6-470a-bd49-b80c85e77aef roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
28192024-09-16T14:47:56.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 70a9dad9-64d6-470a-bd49-b80c85e77aef resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
28202024-09-16T14:47:56.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2566 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 70a9dad9-64d6-470a-bd49-b80c85e77aef response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
28212024-09-16T14:47:57.226ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1984 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f3dd3c9e-00a3-4c70-9bbd-f5d062443413 remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a17f579e-e0fa-40ad-be08-a72304122a23 uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-16T14:47:57.225190975Z }
28222024-09-16T14:47:57.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a17f579e-e0fa-40ad-be08-a72304122a23 roles = RoleSet { roles: {} } uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28232024-09-16T14:47:57.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a17f579e-e0fa-40ad-be08-a72304122a23 resource = Database result = Ok(()) uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28242024-09-16T14:47:57.265ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = f3dd3c9e-00a3-4c70-9bbd-f5d062443413 remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a17f579e-e0fa-40ad-be08-a72304122a23 uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413 vmm_needs_update = true
28252024-09-16T14:47:57.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a17f579e-e0fa-40ad-be08-a72304122a23 roles = RoleSet { roles: {} } uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28262024-09-16T14:47:57.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a17f579e-e0fa-40ad-be08-a72304122a23 resource = Database result = Ok(()) uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28272024-09-16T14:47:57.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a17f579e-e0fa-40ad-be08-a72304122a23 roles = RoleSet { roles: {} } uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28282024-09-16T14:47:57.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a17f579e-e0fa-40ad-be08-a72304122a23 resource = Database result = Ok(()) uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28292024-09-16T14:47:57.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a17f579e-e0fa-40ad-be08-a72304122a23 roles = RoleSet { roles: {} } uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28302024-09-16T14:47:57.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a17f579e-e0fa-40ad-be08-a72304122a23 resource = Database result = Ok(()) uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28312024-09-16T14:47:57.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a17f579e-e0fa-40ad-be08-a72304122a23 roles = RoleSet { roles: {} } uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28322024-09-16T14:47:57.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a17f579e-e0fa-40ad-be08-a72304122a23 resource = Database result = Ok(()) uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28332024-09-16T14:47:57.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a17f579e-e0fa-40ad-be08-a72304122a23 roles = RoleSet { roles: {} } uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28342024-09-16T14:47:57.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a17f579e-e0fa-40ad-be08-a72304122a23 resource = Database result = Ok(()) uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28352024-09-16T14:47:57.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a17f579e-e0fa-40ad-be08-a72304122a23 roles = RoleSet { roles: {} } uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28362024-09-16T14:47:57.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a17f579e-e0fa-40ad-be08-a72304122a23 resource = Database result = Ok(()) uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28372024-09-16T14:47:57.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a17f579e-e0fa-40ad-be08-a72304122a23 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28382024-09-16T14:47:57.308ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a17f579e-e0fa-40ad-be08-a72304122a23 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2f0f2dc2-cb37-4fec-9d0b-492287602073, lookup_type: ById(2f0f2dc2-cb37-4fec-9d0b-492287602073) }, key: 71e71445-febd-4e71-b3a8-f0b412e3d43c, lookup_type: ById(71e71445-febd-4e71-b3a8-f0b412e3d43c) }, key: f84e45da-7f43-4901-939e-774632378ef9, lookup_type: ById(f84e45da-7f43-4901-939e-774632378ef9) } result = Ok(()) uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28392024-09-16T14:47:57.311ZINFOnexus (dropshot_internal): starting update saga for f84e45da-7f43-4901-939e-774632378ef9 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1459 instance_id = f84e45da-7f43-4901-939e-774632378ef9 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a17f579e-e0fa-40ad-be08-a72304122a23 uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-16T14:47:57.225190975Z }
28402024-09-16T14:47:57.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 85834 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a17f579e-e0fa-40ad-be08-a72304122a23 response_code = 204 uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28412024-09-16T14:47:57.311ZDEBGnexus (dropshot_internal): preparing instance-update saga for f84e45da-7f43-4901-939e-774632378ef9... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = f84e45da-7f43-4901-939e-774632378ef9 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a17f579e-e0fa-40ad-be08-a72304122a23 uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28422024-09-16T14:47:57.311ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1984 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f3dd3c9e-00a3-4c70-9bbd-f5d062443413 remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 211c7ac5-0bd2-484d-a7f3-f63571c7ef2d uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-16T14:47:57.225190975Z }
28432024-09-16T14:47:57.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 211c7ac5-0bd2-484d-a7f3-f63571c7ef2d roles = RoleSet { roles: {} } uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28442024-09-16T14:47:57.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 211c7ac5-0bd2-484d-a7f3-f63571c7ef2d resource = Database result = Ok(()) uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28452024-09-16T14:47:57.313ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update
28462024-09-16T14:47:57.313ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"f84e45da-7f43-4901-939e-774632378ef9","lookup_type":{"ById":"f84e45da-7f43-4901-939e-774632378ef9"},"parent":{"key":"71e71445-febd-4e71-b3a8-f0b412e3d43c","lookup_type":{"ById":"71e71445-febd-4e71-b3a8-f0b412e3d43c"},"parent":{"key":"2f0f2dc2-cb37-4fec-9d0b-492287602073","lookup_type":{"ById":"2f0f2dc2-cb37-4fec-9d0b-492287602073"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update sec_id = 1ee13a98-c783-4c45-9593-448411671260
28472024-09-16T14:47:57.313ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update
28482024-09-16T14:47:57.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4220 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 211c7ac5-0bd2-484d-a7f3-f63571c7ef2d response_code = 204 uri = /vmms/f3dd3c9e-00a3-4c70-9bbd-f5d062443413
28492024-09-16T14:47:57.349ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update
28502024-09-16T14:47:57.350ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update sec_id = 1ee13a98-c783-4c45-9593-448411671260
28512024-09-16T14:47:57.350ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 1ee13a98-c783-4c45-9593-448411671260
28522024-09-16T14:47:57.350ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3
28532024-09-16T14:47:57.356ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 1ee13a98-c783-4c45-9593-448411671260
28542024-09-16T14:47:57.356ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3
28552024-09-16T14:47:57.361ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 1ee13a98-c783-4c45-9593-448411671260
28562024-09-16T14:47:57.361ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3
28572024-09-16T14:47:57.365ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 1ee13a98-c783-4c45-9593-448411671260
28582024-09-16T14:47:57.365ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("e36b767c-d11a-4d67-ae83-50ee478f0a35")) node_id = 0 saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3
28592024-09-16T14:47:57.372ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 1ee13a98-c783-4c45-9593-448411671260
28602024-09-16T14:47:57.372ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3
28612024-09-16T14:47:57.376ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = f84e45da-7f43-4901-939e-774632378ef9 saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update
28622024-09-16T14:47:57.376ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = LockInstance
28632024-09-16T14:47:57.377ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = LockInstance
28642024-09-16T14:47:57.379ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = LockInstance
28652024-09-16T14:47:57.379ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = LockInstance
28662024-09-16T14:47:57.381ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = LockInstance
28672024-09-16T14:47:57.381ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = LockInstance
28682024-09-16T14:47:57.383ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = LockInstance
28692024-09-16T14:47:57.383ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = LockInstance
28702024-09-16T14:47:57.416ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = LockInstance
28712024-09-16T14:47:57.417ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = LockInstance
28722024-09-16T14:47:57.418ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = LockInstance
28732024-09-16T14:47:57.418ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = LockInstance
28742024-09-16T14:47:57.419ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = LockInstance
28752024-09-16T14:47:57.422ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2f0f2dc2-cb37-4fec-9d0b-492287602073, lookup_type: ById(2f0f2dc2-cb37-4fec-9d0b-492287602073) }, key: 71e71445-febd-4e71-b3a8-f0b412e3d43c, lookup_type: ById(71e71445-febd-4e71-b3a8-f0b412e3d43c) }, key: f84e45da-7f43-4901-939e-774632378ef9, lookup_type: ById(f84e45da-7f43-4901-939e-774632378ef9) } result = Ok(()) saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = LockInstance
28762024-09-16T14:47:57.422ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = f84e45da-7f43-4901-939e-774632378ef9 saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = LockInstance updater_id = e36b767c-d11a-4d67-ae83-50ee478f0a35
28772024-09-16T14:47:57.422ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = LockInstance
28782024-09-16T14:47:57.422ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = LockInstance
28792024-09-16T14:47:57.436ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = f84e45da-7f43-4901-939e-774632378ef9 saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = LockInstance updater_id = e36b767c-d11a-4d67-ae83-50ee478f0a35
28802024-09-16T14:47:57.436ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = LockInstance
28812024-09-16T14:47:57.436ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = LockInstance
28822024-09-16T14:47:57.441ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = f84e45da-7f43-4901-939e-774632378ef9 locked_gen = Generation(Generation(2)) saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = LockInstance updater_id = e36b767c-d11a-4d67-ae83-50ee478f0a35
28832024-09-16T14:47:57.441ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 1ee13a98-c783-4c45-9593-448411671260
28842024-09-16T14:47:57.441ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("e36b767c-d11a-4d67-ae83-50ee478f0a35")}) node_id = 1 saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3
28852024-09-16T14:47:57.445ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 1ee13a98-c783-4c45-9593-448411671260
28862024-09-16T14:47:57.445ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3
28872024-09-16T14:47:57.450ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
28882024-09-16T14:47:57.451ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
28892024-09-16T14:47:57.454ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
28902024-09-16T14:47:57.454ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
28912024-09-16T14:47:57.456ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
28922024-09-16T14:47:57.456ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
28932024-09-16T14:47:57.457ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
28942024-09-16T14:47:57.460ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2f0f2dc2-cb37-4fec-9d0b-492287602073, lookup_type: ById(2f0f2dc2-cb37-4fec-9d0b-492287602073) }, key: 71e71445-febd-4e71-b3a8-f0b412e3d43c, lookup_type: ById(71e71445-febd-4e71-b3a8-f0b412e3d43c) }, key: f84e45da-7f43-4901-939e-774632378ef9, lookup_type: ById(f84e45da-7f43-4901-939e-774632378ef9) } result = Ok(()) saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
28952024-09-16T14:47:57.460ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
28962024-09-16T14:47:57.460ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
28972024-09-16T14:47:57.465ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: f3dd3c9e-00a3-4c70-9bbd-f5d062443413, time_created: 2024-09-16T14:47:33.180615Z, time_deleted: None, instance_id: f84e45da-7f43-4901-939e-774632378ef9, sled_id: f26461d2-04fe-40aa-80c2-1eb0bc461628, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-09-16T14:47:57.225190Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-09-16T14:47:33.257322Z, gen: Generation(Generation(3)), propolis_id: Some(f3dd3c9e-00a3-4c70-9bbd-f5d062443413), dst_propolis_id: None, migration_id: None, nexus_state: Vmm } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = f84e45da-7f43-4901-939e-774632378ef9 saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(f3dd3c9e-00a3-4c70-9bbd-f5d062443413 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-09-16T14:47:57.465889710Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm }
28982024-09-16T14:47:57.466ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update
28992024-09-16T14:47:57.468ZINFOnexus (SEC): saga create dag = {"end_node":13,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[12,0,null],[11,13,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"f84e45da-7f43-4901-939e-774632378ef9","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"f3dd3c9e-00a3-4c70-9bbd-f5d062443413"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Start":{"params":{"authz_instance":{"key":"f84e45da-7f43-4901-939e-774632378ef9","lookup_type":{"ById":"f84e45da-7f43-4901-939e-774632378ef9"},"parent":{"key":"71e71445-febd-4e71-b3a8-f0b412e3d43c","lookup_type":{"ById":"71e71445-febd-4e71-b3a8-f0b412e3d43c"},"parent":{"key":"2f0f2dc2-cb37-4fec-9d0b-492287602073","lookup_type":{"ById":"2f0f2dc2-cb37-4fec-9d0b-492287602073"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"e36b767c-d11a-4d67-ae83-50ee478f0a35"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"71e71445-febd-4e71-b3a8-f0b412e3d43c","ram_diff":1073741824},"destroy_active_vmm":"f3dd3c9e-00a3-4c70-9bbd-f5d062443413","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_updated":"2024-09-16T14:47:57.465889710Z"}}}}},"End"]},"saga_name":"instance-update","start_node":12} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update sec_id = 1ee13a98-c783-4c45-9593-448411671260
29002024-09-16T14:47:57.468ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update
29012024-09-16T14:47:57.472ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update
29022024-09-16T14:47:57.472ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update sec_id = 1ee13a98-c783-4c45-9593-448411671260
29032024-09-16T14:47:57.472ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 1ee13a98-c783-4c45-9593-448411671260
29042024-09-16T14:47:57.472ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
29052024-09-16T14:47:57.475ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 1ee13a98-c783-4c45-9593-448411671260
29062024-09-16T14:47:57.475ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
29072024-09-16T14:47:57.479ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 1ee13a98-c783-4c45-9593-448411671260
29082024-09-16T14:47:57.479ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
29092024-09-16T14:47:57.482ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 1ee13a98-c783-4c45-9593-448411671260
29102024-09-16T14:47:57.482ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("30f31f3c-413f-4e86-bf6f-3e244cf7d05a")) node_id = 0 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
29112024-09-16T14:47:57.485ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 1ee13a98-c783-4c45-9593-448411671260
29122024-09-16T14:47:57.485ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
29132024-09-16T14:47:57.491ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = f84e45da-7f43-4901-939e-774632378ef9 parent_lock = UpdaterLock { updater_id: e36b767c-d11a-4d67-ae83-50ee478f0a35, locked_gen: Generation(Generation(2)) } saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update
29142024-09-16T14:47:57.491ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = BecomeUpdater
29152024-09-16T14:47:57.491ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = BecomeUpdater
29162024-09-16T14:47:57.499ZDEBGnexus (SagaExecutor): inherited lock from e36b767c-d11a-4d67-ae83-50ee478f0a35 to 30f31f3c-413f-4e86-bf6f-3e244cf7d05a actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = f84e45da-7f43-4901-939e-774632378ef9 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = e36b767c-d11a-4d67-ae83-50ee478f0a35 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = BecomeUpdater updater_id = 30f31f3c-413f-4e86-bf6f-3e244cf7d05a
29172024-09-16T14:47:57.499ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:944 instance_id = f84e45da-7f43-4901-939e-774632378ef9 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update
29182024-09-16T14:47:57.499ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 1ee13a98-c783-4c45-9593-448411671260
29192024-09-16T14:47:57.499ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("30f31f3c-413f-4e86-bf6f-3e244cf7d05a")}) node_id = 1 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
29202024-09-16T14:47:57.503ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 1ee13a98-c783-4c45-9593-448411671260
29212024-09-16T14:47:57.503ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
29222024-09-16T14:47:57.505ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 1ee13a98-c783-4c45-9593-448411671260
29232024-09-16T14:47:57.505ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
29242024-09-16T14:47:57.509ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 1ee13a98-c783-4c45-9593-448411671260
29252024-09-16T14:47:57.509ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
29262024-09-16T14:47:57.512ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:997 instance_id = f84e45da-7f43-4901-939e-774632378ef9 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update
29272024-09-16T14:47:57.514ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = f84e45da-7f43-4901-939e-774632378ef9
29282024-09-16T14:47:57.516ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = UpdateNetworkConfig
29292024-09-16T14:47:57.517ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = UpdateNetworkConfig
29302024-09-16T14:47:57.519ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = UpdateNetworkConfig
29312024-09-16T14:47:57.519ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = UpdateNetworkConfig
29322024-09-16T14:47:57.524ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
29332024-09-16T14:47:57.524ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = UpdateNetworkConfig
29342024-09-16T14:47:57.524ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = UpdateNetworkConfig
29352024-09-16T14:47:57.526ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
29362024-09-16T14:47:57.526ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
29372024-09-16T14:47:57.526ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
29382024-09-16T14:47:57.527ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
29392024-09-16T14:47:57.528ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
29402024-09-16T14:47:57.528ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
29412024-09-16T14:47:57.529ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
29422024-09-16T14:47:57.532ZDEBGnexus: notifying dendrite of updates instance_id = Some(f84e45da-7f43-4901-939e-774632378ef9 (instance)) switch = switch0
29432024-09-16T14:47:57.533ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24166, tv_nsec: 492139922 } })
29442024-09-16T14:47:57.533ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
29452024-09-16T14:47:57.565ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
29462024-09-16T14:47:57.565ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29472024-09-16T14:47:57.565ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "22bdbd6e-6a47-4e1f-89ca-1113a3514746", "content-length": "26", "date": "Mon, 16 Sep 2024 14:47:56 GMT"} })
29482024-09-16T14:47:57.565ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29492024-09-16T14:47:57.566ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29502024-09-16T14:47:57.596ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
29512024-09-16T14:47:57.596ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3734b9fb-269c-4135-97ad-ede1530c2db0", "content-length": "4", "date": "Mon, 16 Sep 2024 14:47:56 GMT"} })
29522024-09-16T14:47:57.596ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 1ee13a98-c783-4c45-9593-448411671260
29532024-09-16T14:47:57.596ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
29542024-09-16T14:47:57.600ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 1ee13a98-c783-4c45-9593-448411671260
29552024-09-16T14:47:57.600ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
29562024-09-16T14:47:57.604ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = ReleaseVirtualProvisioning
29572024-09-16T14:47:57.604ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = ReleaseVirtualProvisioning
29582024-09-16T14:47:57.616ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1072 instance_id = f84e45da-7f43-4901-939e-774632378ef9 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-09-16T14:47:57.607021Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 2f0f2dc2-cb37-4fec-9d0b-492287602073, time_modified: Some(2024-09-16T14:47:57.607021Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 71e71445-febd-4e71-b3a8-f0b412e3d43c, time_modified: Some(2024-09-16T14:47:57.607021Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update
29592024-09-16T14:47:57.616ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 1ee13a98-c783-4c45-9593-448411671260
29602024-09-16T14:47:57.616ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
29612024-09-16T14:47:57.620ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 1ee13a98-c783-4c45-9593-448411671260
29622024-09-16T14:47:57.620ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
29632024-09-16T14:47:57.626ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1107 instance_id = f84e45da-7f43-4901-939e-774632378ef9 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update
29642024-09-16T14:47:57.626ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = UnassignOximeterProducer
29652024-09-16T14:47:57.626ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = UnassignOximeterProducer
29662024-09-16T14:47:57.633ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = d9cae32d-8e84-4f97-9d87-f815a97563b7 producer_id = f84e45da-7f43-4901-939e-774632378ef9 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update
29672024-09-16T14:47:57.633ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = UnassignOximeterProducer
29682024-09-16T14:47:57.633ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = UnassignOximeterProducer
29692024-09-16T14:47:57.666ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = f84e45da-7f43-4901-939e-774632378ef9 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update
29702024-09-16T14:47:57.666ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = f84e45da-7f43-4901-939e-774632378ef9 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/f84e45da-7f43-4901-939e-774632378ef9
29712024-09-16T14:47:57.666ZDEBGnexus (SagaExecutor): client response oximeter-collector = f84e45da-7f43-4901-939e-774632378ef9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers/f84e45da-7f43-4901-939e-774632378ef9", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c33634fb-ec3c-4016-95a8-a3affa7ddf08", "date": "Mon, 16 Sep 2024 14:47:57 GMT"} }) saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update
29722024-09-16T14:47:57.666ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = d9cae32d-8e84-4f97-9d87-f815a97563b7 producer_id = f84e45da-7f43-4901-939e-774632378ef9 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update
29732024-09-16T14:47:57.668ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 1ee13a98-c783-4c45-9593-448411671260
29742024-09-16T14:47:57.668ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
29752024-09-16T14:47:57.671ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 1ee13a98-c783-4c45-9593-448411671260
29762024-09-16T14:47:57.671ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
29772024-09-16T14:47:57.674ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = f84e45da-7f43-4901-939e-774632378ef9 lock = UpdaterLock { updater_id: 30f31f3c-413f-4e86-bf6f-3e244cf7d05a, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-09-16T14:47:57.465889710Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update
29782024-09-16T14:47:57.674ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = CommitInstanceUpdates
29792024-09-16T14:47:57.675ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = CommitInstanceUpdates
29802024-09-16T14:47:57.709ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1156 instance_id = f84e45da-7f43-4901-939e-774632378ef9 new_runtime = InstanceRuntimeState { time_updated: 2024-09-16T14:47:57.465889710Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update
29812024-09-16T14:47:57.709ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = CommitInstanceUpdates
29822024-09-16T14:47:57.709ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Signaled
29832024-09-16T14:47:57.709ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29842024-09-16T14:47:57.710ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = CommitInstanceUpdates
29852024-09-16T14:47:57.710ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Signaled
29862024-09-16T14:47:57.710ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29872024-09-16T14:47:57.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29882024-09-16T14:47:57.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29892024-09-16T14:47:57.711ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = CommitInstanceUpdates
29902024-09-16T14:47:57.711ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = CommitInstanceUpdates
29912024-09-16T14:47:57.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29922024-09-16T14:47:57.712ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = CommitInstanceUpdates
29932024-09-16T14:47:57.712ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = CommitInstanceUpdates
29942024-09-16T14:47:57.713ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29952024-09-16T14:47:57.713ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29962024-09-16T14:47:57.714ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = CommitInstanceUpdates
29972024-09-16T14:47:57.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29982024-09-16T14:47:57.715ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29992024-09-16T14:47:57.717ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30002024-09-16T14:47:57.717ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30012024-09-16T14:47:57.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30022024-09-16T14:47:57.717ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2f0f2dc2-cb37-4fec-9d0b-492287602073, lookup_type: ById(2f0f2dc2-cb37-4fec-9d0b-492287602073) }, key: 71e71445-febd-4e71-b3a8-f0b412e3d43c, lookup_type: ById(71e71445-febd-4e71-b3a8-f0b412e3d43c) }, key: f84e45da-7f43-4901-939e-774632378ef9, lookup_type: ById(f84e45da-7f43-4901-939e-774632378ef9) } result = Ok(()) saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = CommitInstanceUpdates
30032024-09-16T14:47:57.717ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = CommitInstanceUpdates
30042024-09-16T14:47:57.717ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = CommitInstanceUpdates
30052024-09-16T14:47:57.726ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 1ee13a98-c783-4c45-9593-448411671260
30062024-09-16T14:47:57.726ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
30072024-09-16T14:47:57.730ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 1ee13a98-c783-4c45-9593-448411671260
30082024-09-16T14:47:57.730ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
30092024-09-16T14:47:57.734ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 1ee13a98-c783-4c45-9593-448411671260
30102024-09-16T14:47:57.734ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("f84e45da-7f43-4901-939e-774632378ef9"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("f3dd3c9e-00a3-4c70-9bbd-f5d062443413")}) node_id = 7 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
30112024-09-16T14:47:57.737ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 1ee13a98-c783-4c45-9593-448411671260
30122024-09-16T14:47:57.737ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
30132024-09-16T14:47:57.741ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 1ee13a98-c783-4c45-9593-448411671260
30142024-09-16T14:47:57.741ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
30152024-09-16T14:47:57.745ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 1ee13a98-c783-4c45-9593-448411671260
30162024-09-16T14:47:57.745ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
30172024-09-16T14:47:57.754ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = f84e45da-7f43-4901-939e-774632378ef9 propolis_id = f3dd3c9e-00a3-4c70-9bbd-f5d062443413 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update
30182024-09-16T14:47:57.754ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = ReleaseSledResources
30192024-09-16T14:47:57.754ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = ReleaseSledResources
30202024-09-16T14:47:57.758ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 1ee13a98-c783-4c45-9593-448411671260
30212024-09-16T14:47:57.758ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
30222024-09-16T14:47:57.762ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 1ee13a98-c783-4c45-9593-448411671260
30232024-09-16T14:47:57.762ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
30242024-09-16T14:47:57.765ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = f84e45da-7f43-4901-939e-774632378ef9 propolis_id = f3dd3c9e-00a3-4c70-9bbd-f5d062443413 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update
30252024-09-16T14:47:57.765ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = MarkVmmDeleted
30262024-09-16T14:47:57.765ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_node = MarkVmmDeleted
30272024-09-16T14:47:57.804ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 1ee13a98-c783-4c45-9593-448411671260
30282024-09-16T14:47:57.804ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
30292024-09-16T14:47:57.806ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 1ee13a98-c783-4c45-9593-448411671260
30302024-09-16T14:47:57.806ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
30312024-09-16T14:47:57.810ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 1ee13a98-c783-4c45-9593-448411671260
30322024-09-16T14:47:57.810ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
30332024-09-16T14:47:57.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30342024-09-16T14:47:57.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30352024-09-16T14:47:57.811ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30362024-09-16T14:47:57.812ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bb59550e-0ab5-44e5-b7d9-537d6bc0748a", "content-length": "372", "date": "Mon, 16 Sep 2024 14:47:57 GMT"} })
30372024-09-16T14:47:57.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30382024-09-16T14:47:57.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30392024-09-16T14:47:57.813ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 1ee13a98-c783-4c45-9593-448411671260
30402024-09-16T14:47:57.813ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
30412024-09-16T14:47:57.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30422024-09-16T14:47:57.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30432024-09-16T14:47:57.816ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 1ee13a98-c783-4c45-9593-448411671260
30442024-09-16T14:47:57.816ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
30452024-09-16T14:47:57.817ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30462024-09-16T14:47:57.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30472024-09-16T14:47:57.820ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c sec_id = 1ee13a98-c783-4c45-9593-448411671260
30482024-09-16T14:47:57.820ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c
30492024-09-16T14:47:57.820ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30502024-09-16T14:47:57.820ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9092fe21-9f6c-479d-8114-da31a8e33ec3", "date": "Mon, 16 Sep 2024 14:47:57 GMT"} })
30512024-09-16T14:47:57.822ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 112.472403ms iteration = 16 status = {}
30522024-09-16T14:47:57.851ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update sec_id = 1ee13a98-c783-4c45-9593-448411671260
30532024-09-16T14:47:57.851ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c saga_name = instance-update saga_result = SagaResult { saga_id: f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c, saga_log: SagaLog { saga_id: f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c, unwinding: false, events: [N012 started, N012 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N013 started, N013 succeeded], node_status: {0: Succeeded(String("30f31f3c-413f-4e86-bf6f-3e244cf7d05a")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("30f31f3c-413f-4e86-bf6f-3e244cf7d05a")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("f84e45da-7f43-4901-939e-774632378ef9"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("f3dd3c9e-00a3-4c70-9bbd-f5d062443413")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("f84e45da-7f43-4901-939e-774632378ef9"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("f3dd3c9e-00a3-4c70-9bbd-f5d062443413")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("30f31f3c-413f-4e86-bf6f-3e244cf7d05a"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("30f31f3c-413f-4e86-bf6f-3e244cf7d05a")}} }) }
30542024-09-16T14:47:57.851ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = f38a7cdf-f5f4-4ce9-8ffa-271d391bfa4c instance_id = f84e45da-7f43-4901-939e-774632378ef9 saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update
30552024-09-16T14:47:57.851ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 1ee13a98-c783-4c45-9593-448411671260
30562024-09-16T14:47:57.851ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3
30572024-09-16T14:47:57.855ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 1ee13a98-c783-4c45-9593-448411671260
30582024-09-16T14:47:57.855ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3
30592024-09-16T14:47:57.858ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 1ee13a98-c783-4c45-9593-448411671260
30602024-09-16T14:47:57.858ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3
30612024-09-16T14:47:57.861ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 sec_id = 1ee13a98-c783-4c45-9593-448411671260
30622024-09-16T14:47:57.861ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3
30632024-09-16T14:47:57.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30642024-09-16T14:47:57.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30652024-09-16T14:47:57.896ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30662024-09-16T14:47:57.898ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30672024-09-16T14:47:57.898ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30682024-09-16T14:47:57.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30692024-09-16T14:47:57.907ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update sec_id = 1ee13a98-c783-4c45-9593-448411671260
30702024-09-16T14:47:57.907ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = 4949d513-734c-42a8-a0e9-1730eb391cb3 saga_name = start-instance-update saga_result = SagaResult { saga_id: 4949d513-734c-42a8-a0e9-1730eb391cb3, saga_log: SagaLog { saga_id: 4949d513-734c-42a8-a0e9-1730eb391cb3, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("e36b767c-d11a-4d67-ae83-50ee478f0a35")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("e36b767c-d11a-4d67-ae83-50ee478f0a35")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("e36b767c-d11a-4d67-ae83-50ee478f0a35"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("e36b767c-d11a-4d67-ae83-50ee478f0a35")}} }) }
30712024-09-16T14:47:57.928ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30722024-09-16T14:47:57.930ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30732024-09-16T14:47:57.930ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30742024-09-16T14:47:57.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30752024-09-16T14:47:57.966ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
30762024-09-16T14:47:57.966ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2c2dacba-1f97-40dd-a7ca-4d7e54cacfc0", "content-length": "691", "date": "Mon, 16 Sep 2024 14:47:57 GMT"} })
30772024-09-16T14:47:57.966ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
30782024-09-16T14:47:57.966ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
30792024-09-16T14:47:57.966ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
30802024-09-16T14:47:57.967ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 257.682408ms iteration = 15 status = {}
30812024-09-16T14:47:57.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 0db563da-1511-4853-96da-73507d781a81 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
30822024-09-16T14:47:57.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 0db563da-1511-4853-96da-73507d781a81 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
30832024-09-16T14:47:57.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2038 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 0db563da-1511-4853-96da-73507d781a81 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
30842024-09-16T14:47:58.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f79787a9-8d1b-491d-adbc-07503f378b5c roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
30852024-09-16T14:47:58.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f79787a9-8d1b-491d-adbc-07503f378b5c resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
30862024-09-16T14:47:58.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f79787a9-8d1b-491d-adbc-07503f378b5c response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
30872024-09-16T14:48:00.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 67ce10a8-da31-4a36-b026-0083a414acdc roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
30882024-09-16T14:48:00.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 67ce10a8-da31-4a36-b026-0083a414acdc resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
30892024-09-16T14:48:00.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 67ce10a8-da31-4a36-b026-0083a414acdc response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
30902024-09-16T14:48:01.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = fe17413e-f62e-444e-8d15-ef3d3b2e4988 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
30912024-09-16T14:48:01.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = fe17413e-f62e-444e-8d15-ef3d3b2e4988 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
30922024-09-16T14:48:01.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2812 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = fe17413e-f62e-444e-8d15-ef3d3b2e4988 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
30932024-09-16T14:48:01.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
30942024-09-16T14:48:01.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
30952024-09-16T14:48:01.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30962024-09-16T14:48:01.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30972024-09-16T14:48:01.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30982024-09-16T14:48:01.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30992024-09-16T14:48:01.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31002024-09-16T14:48:01.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31012024-09-16T14:48:01.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31022024-09-16T14:48:01.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31032024-09-16T14:48:01.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31042024-09-16T14:48:01.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31052024-09-16T14:48:01.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31062024-09-16T14:48:01.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
31072024-09-16T14:48:01.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31082024-09-16T14:48:01.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31092024-09-16T14:48:01.573ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
31102024-09-16T14:48:01.573ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.205786ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
31112024-09-16T14:48:01.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31122024-09-16T14:48:01.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31132024-09-16T14:48:01.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.106902ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31142024-09-16T14:48:02.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 010ba736-7469-4c51-8437-0352616e593f roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31152024-09-16T14:48:02.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 010ba736-7469-4c51-8437-0352616e593f resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31162024-09-16T14:48:02.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 010ba736-7469-4c51-8437-0352616e593f response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31172024-09-16T14:48:03.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a8f90915-44d6-4538-8dba-9fd21cb389ea roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31182024-09-16T14:48:03.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a8f90915-44d6-4538-8dba-9fd21cb389ea resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31192024-09-16T14:48:03.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a8f90915-44d6-4538-8dba-9fd21cb389ea response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31202024-09-16T14:48:04.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5a2f0c3e-28cb-49b0-a053-ddcb6b4ced03 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31212024-09-16T14:48:04.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5a2f0c3e-28cb-49b0-a053-ddcb6b4ced03 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31222024-09-16T14:48:04.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2524 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5a2f0c3e-28cb-49b0-a053-ddcb6b4ced03 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31232024-09-16T14:48:05.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 79cc1652-4d0b-44eb-915a-cb258f076c91 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31242024-09-16T14:48:05.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 79cc1652-4d0b-44eb-915a-cb258f076c91 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31252024-09-16T14:48:05.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2564 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 79cc1652-4d0b-44eb-915a-cb258f076c91 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31262024-09-16T14:48:05.852ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1511 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = f37ba98a-3557-4c35-a27a-abddce4352a8 response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
31272024-09-16T14:48:06.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = cbf7939d-5dcd-4cb3-ac1e-09c0a39ea295 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31282024-09-16T14:48:06.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = cbf7939d-5dcd-4cb3-ac1e-09c0a39ea295 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31292024-09-16T14:48:06.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = cbf7939d-5dcd-4cb3-ac1e-09c0a39ea295 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31302024-09-16T14:48:07.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 303c6d1d-5b0e-4afa-8715-2e5622aea31c roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31312024-09-16T14:48:07.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 303c6d1d-5b0e-4afa-8715-2e5622aea31c resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31322024-09-16T14:48:07.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 303c6d1d-5b0e-4afa-8715-2e5622aea31c response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31332024-09-16T14:48:08.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d4396824-ee8f-4aa6-b674-531777dd948c roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31342024-09-16T14:48:08.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d4396824-ee8f-4aa6-b674-531777dd948c resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31352024-09-16T14:48:08.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d4396824-ee8f-4aa6-b674-531777dd948c response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31362024-09-16T14:48:09.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 07f5ae64-fe34-4d27-ae68-7784bc6b52ab roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31372024-09-16T14:48:09.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 07f5ae64-fe34-4d27-ae68-7784bc6b52ab resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31382024-09-16T14:48:09.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2663 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 07f5ae64-fe34-4d27-ae68-7784bc6b52ab response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31392024-09-16T14:48:10.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = dc8a502d-4799-4878-82f0-bbd3c6456960 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31402024-09-16T14:48:10.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = dc8a502d-4799-4878-82f0-bbd3c6456960 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31412024-09-16T14:48:10.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2707 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = dc8a502d-4799-4878-82f0-bbd3c6456960 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31422024-09-16T14:48:11.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8473f5b7-2886-478f-9a6f-4cfbbf20dc14 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31432024-09-16T14:48:11.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8473f5b7-2886-478f-9a6f-4cfbbf20dc14 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31442024-09-16T14:48:11.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8473f5b7-2886-478f-9a6f-4cfbbf20dc14 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31452024-09-16T14:48:11.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
31462024-09-16T14:48:11.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
31472024-09-16T14:48:11.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31482024-09-16T14:48:11.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31492024-09-16T14:48:11.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31502024-09-16T14:48:11.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31512024-09-16T14:48:11.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31522024-09-16T14:48:11.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31532024-09-16T14:48:11.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31542024-09-16T14:48:11.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31552024-09-16T14:48:11.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31562024-09-16T14:48:11.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31572024-09-16T14:48:11.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31582024-09-16T14:48:11.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31592024-09-16T14:48:11.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31602024-09-16T14:48:11.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
31612024-09-16T14:48:11.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31622024-09-16T14:48:11.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31632024-09-16T14:48:11.598ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
31642024-09-16T14:48:11.598ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.327724ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
31652024-09-16T14:48:11.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.680592ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31662024-09-16T14:48:12.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 17bfa69b-8e3c-4439-90c7-b85781c238b7 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31672024-09-16T14:48:12.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 17bfa69b-8e3c-4439-90c7-b85781c238b7 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31682024-09-16T14:48:12.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 17bfa69b-8e3c-4439-90c7-b85781c238b7 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31692024-09-16T14:48:13.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 27f726f4-8d2d-4ab1-b6b0-366132093b16 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31702024-09-16T14:48:13.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 27f726f4-8d2d-4ab1-b6b0-366132093b16 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31712024-09-16T14:48:13.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 27f726f4-8d2d-4ab1-b6b0-366132093b16 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31722024-09-16T14:48:14.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = cb367629-3aeb-4a53-9df0-a10e1c74624c roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31732024-09-16T14:48:14.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = cb367629-3aeb-4a53-9df0-a10e1c74624c resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31742024-09-16T14:48:14.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = cb367629-3aeb-4a53-9df0-a10e1c74624c response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31752024-09-16T14:48:15.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6cedd3fb-5c15-42e9-846b-8db415343a69 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31762024-09-16T14:48:15.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6cedd3fb-5c15-42e9-846b-8db415343a69 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31772024-09-16T14:48:15.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6cedd3fb-5c15-42e9-846b-8db415343a69 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31782024-09-16T14:48:15.852ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1609 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = b45c5a0d-ac28-4d49-8e1f-710422e9eeb7 response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
31792024-09-16T14:48:16.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a3f4ecdc-7807-48f4-a99c-d0390fc21699 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31802024-09-16T14:48:16.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a3f4ecdc-7807-48f4-a99c-d0390fc21699 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31812024-09-16T14:48:16.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1761 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a3f4ecdc-7807-48f4-a99c-d0390fc21699 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31822024-09-16T14:48:17.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = caf63b8d-fd44-4f70-b2a6-4b08c51df4f5 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31832024-09-16T14:48:17.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = caf63b8d-fd44-4f70-b2a6-4b08c51df4f5 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31842024-09-16T14:48:17.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = caf63b8d-fd44-4f70-b2a6-4b08c51df4f5 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31852024-09-16T14:48:18.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f6ab4d65-1c1f-4613-ae39-51278f5c544d roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31862024-09-16T14:48:18.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f6ab4d65-1c1f-4613-ae39-51278f5c544d resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31872024-09-16T14:48:18.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2700 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f6ab4d65-1c1f-4613-ae39-51278f5c544d response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31882024-09-16T14:48:19.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f3414230-3377-4350-9656-18274f84e735 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31892024-09-16T14:48:19.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f3414230-3377-4350-9656-18274f84e735 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31902024-09-16T14:48:19.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f3414230-3377-4350-9656-18274f84e735 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31912024-09-16T14:48:20.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 1229d938-b4f6-4553-9949-72596bd44ac3 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31922024-09-16T14:48:20.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 1229d938-b4f6-4553-9949-72596bd44ac3 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31932024-09-16T14:48:20.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 1229d938-b4f6-4553-9949-72596bd44ac3 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31942024-09-16T14:48:21.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6db905a8-8cc4-4de3-9fee-36bc3b402c31 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31952024-09-16T14:48:21.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6db905a8-8cc4-4de3-9fee-36bc3b402c31 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31962024-09-16T14:48:21.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1690 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 6db905a8-8cc4-4de3-9fee-36bc3b402c31 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
31972024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
31982024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
31992024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
32002024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32012024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32022024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
32032024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32042024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
32052024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32062024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
32072024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
32082024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32092024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
32102024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32112024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
32122024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
32132024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
32142024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
32152024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
32162024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32172024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
32182024-09-16T14:48:21.554ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
32192024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32202024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
32212024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
32222024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32232024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
32242024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
32252024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32262024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
32272024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
32282024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
32292024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32302024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
32312024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32322024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
32332024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
32342024-09-16T14:48:21.554ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2
32352024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.74\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2"}
32362024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
32372024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
32382024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
32392024-09-16T14:48:21.554ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
32402024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
32412024-09-16T14:48:21.555ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-16 14:38:21.554879533 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
32422024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32432024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32442024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
32452024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
32462024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
32472024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
32482024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
32492024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32502024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
32512024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
32522024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
32532024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
32542024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32552024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32562024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32572024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32582024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32592024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32602024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
32612024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32622024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32632024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32642024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
32652024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
32662024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32672024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32682024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32692024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32702024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
32712024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32722024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32732024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
32742024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32752024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32762024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
32772024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32782024-09-16T14:48:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32792024-09-16T14:48:21.555ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("216291e2-64d0-4e57-82ea-84523304c97b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fcbfd0d4-0b48-4392-95df-b0bdb2c97118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fcbfd0d4-0b48-4392-95df-b0bdb2c97118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 24190, tv_nsec: 514223310 } })
32802024-09-16T14:48:21.555ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0839d410-88e5-4168-91a3-1340a5d7a912.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f93623c-a4f4-43d1-b285-fdbdeccdc7e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fc6cb4c7-5a91-4879-8aba-57c83b2f5553.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fc6cb4c7-5a91-4879-8aba-57c83b2f5553.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 24190, tv_nsec: 514285862 } })
32812024-09-16T14:48:21.557ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
32822024-09-16T14:48:21.557ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.835504ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
32832024-09-16T14:48:21.557ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
32842024-09-16T14:48:21.557ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.839224ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
32852024-09-16T14:48:21.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32862024-09-16T14:48:21.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32872024-09-16T14:48:21.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32882024-09-16T14:48:21.559ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.564358ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
32892024-09-16T14:48:21.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
32902024-09-16T14:48:21.561ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32912024-09-16T14:48:21.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32922024-09-16T14:48:21.565ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24190, tv_nsec: 524591358 } })
32932024-09-16T14:48:21.566ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
32942024-09-16T14:48:21.566ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32952024-09-16T14:48:21.566ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32962024-09-16T14:48:21.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32972024-09-16T14:48:21.568ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-16 14:38:21.554879533 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
32982024-09-16T14:48:21.568ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.139341ms iteration = 8 status = {"expiration":"2024-09-16T14:38:21.554879533Z","pruned":[]}
32992024-09-16T14:48:21.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33002024-09-16T14:48:21.569ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33012024-09-16T14:48:21.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33022024-09-16T14:48:21.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33032024-09-16T14:48:21.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33042024-09-16T14:48:21.573ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.201797ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
33052024-09-16T14:48:21.573ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24190, tv_nsec: 532368406 } })
33062024-09-16T14:48:21.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
33072024-09-16T14:48:21.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33082024-09-16T14:48:21.579ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33092024-09-16T14:48:21.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33102024-09-16T14:48:21.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33112024-09-16T14:48:21.583ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33122024-09-16T14:48:21.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33132024-09-16T14:48:21.603ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33142024-09-16T14:48:21.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
33152024-09-16T14:48:21.606ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33162024-09-16T14:48:21.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33172024-09-16T14:48:21.612ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
33182024-09-16T14:48:21.612ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
33192024-09-16T14:48:21.612ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 57.387574ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
33202024-09-16T14:48:21.612ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33212024-09-16T14:48:21.614ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24190, tv_nsec: 573458479 } })
33222024-09-16T14:48:21.615ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
33232024-09-16T14:48:21.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
33242024-09-16T14:48:21.615ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33252024-09-16T14:48:21.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33262024-09-16T14:48:21.615ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
33272024-09-16T14:48:21.615ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
33282024-09-16T14:48:21.615ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33292024-09-16T14:48:21.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33302024-09-16T14:48:21.617ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33312024-09-16T14:48:21.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33322024-09-16T14:48:21.618ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.888186ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
33332024-09-16T14:48:21.620ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33342024-09-16T14:48:21.623ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33352024-09-16T14:48:21.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33362024-09-16T14:48:21.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
33372024-09-16T14:48:21.625ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33382024-09-16T14:48:21.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33392024-09-16T14:48:21.626ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33402024-09-16T14:48:21.626ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33412024-09-16T14:48:21.626ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33422024-09-16T14:48:21.626ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33432024-09-16T14:48:21.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33442024-09-16T14:48:21.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33452024-09-16T14:48:21.627ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33462024-09-16T14:48:21.627ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33472024-09-16T14:48:21.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33482024-09-16T14:48:21.628ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33492024-09-16T14:48:21.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33502024-09-16T14:48:21.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33512024-09-16T14:48:21.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33522024-09-16T14:48:21.631ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33532024-09-16T14:48:21.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33542024-09-16T14:48:21.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33552024-09-16T14:48:21.632ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 77.760641ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33562024-09-16T14:48:21.634ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33572024-09-16T14:48:21.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33582024-09-16T14:48:21.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 80.797579ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
33592024-09-16T14:48:21.636ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33602024-09-16T14:48:21.639ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33612024-09-16T14:48:21.639ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33622024-09-16T14:48:21.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33632024-09-16T14:48:21.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33642024-09-16T14:48:21.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33652024-09-16T14:48:21.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33662024-09-16T14:48:21.663ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:539 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
33672024-09-16T14:48:21.663ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
33682024-09-16T14:48:21.663ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
33692024-09-16T14:48:21.663ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
33702024-09-16T14:48:21.663ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 109.023927ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
33712024-09-16T14:48:21.663ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33722024-09-16T14:48:21.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33732024-09-16T14:48:21.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33742024-09-16T14:48:21.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33752024-09-16T14:48:21.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33762024-09-16T14:48:21.668ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33772024-09-16T14:48:21.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33782024-09-16T14:48:21.673ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33792024-09-16T14:48:21.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33802024-09-16T14:48:21.674ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
33812024-09-16T14:48:21.674ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
33822024-09-16T14:48:21.674ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33832024-09-16T14:48:21.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33842024-09-16T14:48:21.675ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 120.881013ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
33852024-09-16T14:48:21.683ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33862024-09-16T14:48:21.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33872024-09-16T14:48:21.685ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
33882024-09-16T14:48:21.685ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
33892024-09-16T14:48:21.685ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 130.866493ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
33902024-09-16T14:48:21.688ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
33912024-09-16T14:48:21.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33922024-09-16T14:48:21.710ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33932024-09-16T14:48:21.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33942024-09-16T14:48:21.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
33952024-09-16T14:48:21.714ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33962024-09-16T14:48:21.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33972024-09-16T14:48:21.717ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
33982024-09-16T14:48:21.717ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
33992024-09-16T14:48:21.717ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
34002024-09-16T14:48:21.717ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34012024-09-16T14:48:21.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34022024-09-16T14:48:21.718ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 163.150738ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
34032024-09-16T14:48:21.721ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34042024-09-16T14:48:21.721ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34052024-09-16T14:48:21.726ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
34062024-09-16T14:48:21.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34072024-09-16T14:48:21.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34082024-09-16T14:48:21.726ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34092024-09-16T14:48:21.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34102024-09-16T14:48:21.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34112024-09-16T14:48:21.750ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
34122024-09-16T14:48:21.777ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 zone_address = fd00:1122:3344:101::2
34132024-09-16T14:48:21.777ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34142024-09-16T14:48:21.778ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f1933fd8-5376-4f3a-8bac-801addc1251e", "content-length": "26", "date": "Mon, 16 Sep 2024 14:48:21 GMT"} })
34152024-09-16T14:48:21.778ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34162024-09-16T14:48:21.780ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
34172024-09-16T14:48:21.782ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
34182024-09-16T14:48:21.782ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34192024-09-16T14:48:21.783ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2f7b5cef-6782-40c6-8c7b-fdc6d1080f20", "content-length": "26", "date": "Mon, 16 Sep 2024 14:48:21 GMT"} })
34202024-09-16T14:48:21.783ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34212024-09-16T14:48:21.786ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34222024-09-16T14:48:21.830ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34232024-09-16T14:48:21.830ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "08c5b34f-f720-4367-8ba8-f0b4a8ef764c", "content-length": "372", "date": "Mon, 16 Sep 2024 14:48:21 GMT"} })
34242024-09-16T14:48:21.830ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34252024-09-16T14:48:21.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34262024-09-16T14:48:21.832ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34272024-09-16T14:48:21.834ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34282024-09-16T14:48:21.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34292024-09-16T14:48:21.835ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34302024-09-16T14:48:21.835ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34312024-09-16T14:48:21.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34322024-09-16T14:48:21.838ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
34332024-09-16T14:48:21.839ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34342024-09-16T14:48:21.839ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34352024-09-16T14:48:21.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f26461d2-04fe-40aa-80c2-1eb0bc461628, lookup_type: ById(f26461d2-04fe-40aa-80c2-1eb0bc461628) } result = Ok(())
34362024-09-16T14:48:21.842ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34372024-09-16T14:48:21.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34382024-09-16T14:48:21.842ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34392024-09-16T14:48:21.842ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34402024-09-16T14:48:21.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34412024-09-16T14:48:21.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34422024-09-16T14:48:21.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34432024-09-16T14:48:21.850ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
34442024-09-16T14:48:21.850ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 295.478348ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
34452024-09-16T14:48:21.850ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 296.056939ms iteration = 15 status = 0
34462024-09-16T14:48:21.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34472024-09-16T14:48:21.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34482024-09-16T14:48:21.857ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34492024-09-16T14:48:21.857ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "cb6a047a-1cc0-41cf-86d6-99daf2095b93", "date": "Mon, 16 Sep 2024 14:48:21 GMT"} })
34502024-09-16T14:48:21.859ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 305.169282ms iteration = 17 status = {}
34512024-09-16T14:48:21.871ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
34522024-09-16T14:48:21.871ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:226 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
34532024-09-16T14:48:21.871ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 316.873566ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
34542024-09-16T14:48:21.875ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 320.694309ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
34552024-09-16T14:48:21.877ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
34562024-09-16T14:48:21.877ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34572024-09-16T14:48:21.877ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d70d9c11-14c5-40d0-be17-039af1ae521e dns_zone_name = oxide.test found_so_far = 0 version = 2
34582024-09-16T14:48:21.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34592024-09-16T14:48:21.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34602024-09-16T14:48:21.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34612024-09-16T14:48:21.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34622024-09-16T14:48:21.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34632024-09-16T14:48:21.880ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34642024-09-16T14:48:21.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34652024-09-16T14:48:21.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34662024-09-16T14:48:21.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34672024-09-16T14:48:21.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34682024-09-16T14:48:21.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34692024-09-16T14:48:21.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34702024-09-16T14:48:21.883ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34712024-09-16T14:48:21.883ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34722024-09-16T14:48:21.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34732024-09-16T14:48:21.885ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d70d9c11-14c5-40d0-be17-039af1ae521e dns_zone_name = oxide.test found_so_far = 1 version = 2
34742024-09-16T14:48:21.885ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
34752024-09-16T14:48:21.885ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-16 14:41:24.562175 UTC dns_group = external generation = 2
34762024-09-16T14:48:21.885ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 330.257381ms iteration = 9 status = {"generation":2}
34772024-09-16T14:48:21.912ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
34782024-09-16T14:48:21.912ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 01c7aafc-c1b7-42bb-a493-0c643f2e21db dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
34792024-09-16T14:48:21.912ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34802024-09-16T14:48:21.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34812024-09-16T14:48:21.914ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34822024-09-16T14:48:21.916ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-16T14:41:19.171997Z, time_modified: 2024-09-16T14:41:19.171997Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2f0f2dc2-cb37-4fec-9d0b-492287602073, db_silo: Silo { identity: SiloIdentity { id: 2f0f2dc2-cb37-4fec-9d0b-492287602073, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-16T14:41:24.495850Z, time_modified: 2024-09-16T14:41:24.495850Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "7a1e72c489a058dd07f837cad69c701f6b45e7cf21c6d4f626d443caf9673a83" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2f0f2dc2-cb37-4fec-9d0b-492287602073, db_silo: Silo { identity: SiloIdentity { id: 2f0f2dc2-cb37-4fec-9d0b-492287602073, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-16T14:41:24.495850Z, time_modified: 2024-09-16T14:41:24.495850Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "7a1e72c489a058dd07f837cad69c701f6b45e7cf21c6d4f626d443caf9673a83" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
34832024-09-16T14:48:21.916ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 362.012405ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2f0f2dc2-cb37-4fec-9d0b-492287602073","tls_certs":["7a1e72c489a058dd07f837cad69c701f6b45e7cf21c6d4f626d443caf9673a83"]}},"default_endpoint":{"silo_id":"2f0f2dc2-cb37-4fec-9d0b-492287602073","tls_certs":["7a1e72c489a058dd07f837cad69c701f6b45e7cf21c6d4f626d443caf9673a83"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
34842024-09-16T14:48:21.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34852024-09-16T14:48:21.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34862024-09-16T14:48:21.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34872024-09-16T14:48:21.919ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 01c7aafc-c1b7-42bb-a493-0c643f2e21db dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
34882024-09-16T14:48:21.919ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
34892024-09-16T14:48:21.919ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-16 14:41:23.295040 UTC dns_group = internal generation = 1
34902024-09-16T14:48:21.919ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 364.486883ms iteration = 9 status = {"generation":1}
34912024-09-16T14:48:21.929ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 374.480163ms iteration = 18 status = {"physical_disks_added":0}
34922024-09-16T14:48:21.937ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
34932024-09-16T14:48:21.937ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34942024-09-16T14:48:21.937ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a95edaae-4d3b-42b0-a23b-777475d7ae82", "content-length": "26", "date": "Mon, 16 Sep 2024 14:48:21 GMT"} })
34952024-09-16T14:48:21.937ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34962024-09-16T14:48:21.940ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34972024-09-16T14:48:21.948ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 393.386913ms iteration = 15 status = {}
34982024-09-16T14:48:22.040ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
34992024-09-16T14:48:22.041ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f591a6f0-8450-4839-8833-b6a9beac0289", "date": "Mon, 16 Sep 2024 14:48:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35002024-09-16T14:48:22.041ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35012024-09-16T14:48:22.043ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d3c421a7-920c-4199-a8f8-14b601cde3f9", "date": "Mon, 16 Sep 2024 14:48:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35022024-09-16T14:48:22.043ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35032024-09-16T14:48:22.045ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "03def253-8f9e-4237-9e68-31233fe69bd4", "date": "Mon, 16 Sep 2024 14:48:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35042024-09-16T14:48:22.045ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35052024-09-16T14:48:22.047ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35062024-09-16T14:48:22.047ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 493.084112ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
35072024-09-16T14:48:22.062ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
35082024-09-16T14:48:22.062ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d11b2ae3-d2b8-4605-88ba-b30a88057c14", "date": "Mon, 16 Sep 2024 14:48:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35092024-09-16T14:48:22.062ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35102024-09-16T14:48:22.064ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f82729ab-2c1c-4b57-b00d-2e06f5d4a768", "date": "Mon, 16 Sep 2024 14:48:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35112024-09-16T14:48:22.064ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35122024-09-16T14:48:22.066ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
35132024-09-16T14:48:22.066ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0c174ece-7c35-43c2-ae40-7dd74cc92dd4", "content-length": "691", "date": "Mon, 16 Sep 2024 14:48:22 GMT"} })
35142024-09-16T14:48:22.066ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
35152024-09-16T14:48:22.066ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
35162024-09-16T14:48:22.066ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
35172024-09-16T14:48:22.066ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35182024-09-16T14:48:22.066ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 511.907561ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
35192024-09-16T14:48:22.068ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 513.306547ms iteration = 16 status = {}
35202024-09-16T14:48:22.092ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
35212024-09-16T14:48:22.092ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e4241c7f-9d28-427c-b464-c67644b10618", "content-length": "2", "date": "Mon, 16 Sep 2024 14:48:21 GMT"} })
35222024-09-16T14:48:22.094ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35232024-09-16T14:48:22.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35242024-09-16T14:48:22.096ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 541.79168ms iteration = 15 status = null
35252024-09-16T14:48:22.146ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35262024-09-16T14:48:22.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35272024-09-16T14:48:22.148ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 94d6770e-63ed-455d-aa9f-8ad47c66c84e, rack_id: 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bc13c6ca-2923-40a0-a45c-bfa5d94842d2) } rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0
35282024-09-16T14:48:22.148ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35292024-09-16T14:48:22.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35302024-09-16T14:48:22.158ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
35312024-09-16T14:48:22.159ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "71cf8a11-f4f6-4bf6-99ca-38a2f98b1c4b", "content-length": "121", "date": "Mon, 16 Sep 2024 14:48:21 GMT"} })
35322024-09-16T14:48:22.159ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
35332024-09-16T14:48:22.159ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bc13c6ca-2923-40a0-a45c-bfa5d94842d2
35342024-09-16T14:48:22.159ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
35352024-09-16T14:48:22.159ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
35362024-09-16T14:48:22.159ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {}
35372024-09-16T14:48:22.159ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {}
35382024-09-16T14:48:22.159ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
35392024-09-16T14:48:22.159ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35402024-09-16T14:48:22.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35412024-09-16T14:48:22.161ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
35422024-09-16T14:48:22.161ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b51e1cbb-88d7-4fa5-b17a-bf0d3c96f02c", "content-length": "2", "date": "Mon, 16 Sep 2024 14:48:21 GMT"} })
35432024-09-16T14:48:22.161ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
35442024-09-16T14:48:22.161ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "66359753-48f6-424b-89b7-179e674b2d5f", "content-length": "52", "date": "Mon, 16 Sep 2024 14:48:21 GMT"} })
35452024-09-16T14:48:22.161ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0
35462024-09-16T14:48:22.161ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
35472024-09-16T14:48:22.262ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ba6e3a2e-9a81-47ce-899e-21f7fd8ff934", "date": "Mon, 16 Sep 2024 14:48:22 GMT"} })
35482024-09-16T14:48:22.262ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch = Switch0
35492024-09-16T14:48:22.262ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
35502024-09-16T14:48:22.266ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "63353d5d-e65e-4597-b53e-150ea6e601b4", "content-length": "667", "date": "Mon, 16 Sep 2024 14:48:21 GMT"} })
35512024-09-16T14:48:22.266ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35522024-09-16T14:48:22.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35532024-09-16T14:48:22.270ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35542024-09-16T14:48:22.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35552024-09-16T14:48:22.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35562024-09-16T14:48:22.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35572024-09-16T14:48:22.280ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35582024-09-16T14:48:22.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35592024-09-16T14:48:22.288ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 733.407019ms iteration = 15 status = {}
35602024-09-16T14:48:22.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 68491f4e-659e-48f3-bac4-47331e5aab9c roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35612024-09-16T14:48:22.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 68491f4e-659e-48f3-bac4-47331e5aab9c resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35622024-09-16T14:48:22.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 68491f4e-659e-48f3-bac4-47331e5aab9c response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35632024-09-16T14:48:23.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5860cdcd-2e63-479b-a518-d227e80495eb roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35642024-09-16T14:48:23.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5860cdcd-2e63-479b-a518-d227e80495eb resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35652024-09-16T14:48:23.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5860cdcd-2e63-479b-a518-d227e80495eb response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35662024-09-16T14:48:24.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d5d689b7-32e2-472b-a674-4b2d1e901853 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35672024-09-16T14:48:24.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d5d689b7-32e2-472b-a674-4b2d1e901853 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35682024-09-16T14:48:24.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d5d689b7-32e2-472b-a674-4b2d1e901853 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35692024-09-16T14:48:25.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 0cdc8dc6-0229-4660-8c50-ba387bfd70e4 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35702024-09-16T14:48:25.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 0cdc8dc6-0229-4660-8c50-ba387bfd70e4 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35712024-09-16T14:48:25.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 0cdc8dc6-0229-4660-8c50-ba387bfd70e4 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35722024-09-16T14:48:25.852ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1782 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = b345971d-c50b-47f4-98ec-4d146d5e0b13 response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
35732024-09-16T14:48:26.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 2b96820b-6c8d-47bb-80a9-e09c58730e8b roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35742024-09-16T14:48:26.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 2b96820b-6c8d-47bb-80a9-e09c58730e8b resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35752024-09-16T14:48:26.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2501 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 2b96820b-6c8d-47bb-80a9-e09c58730e8b response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35762024-09-16T14:48:27.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 09b53db5-32e3-4448-b389-45eb905848b5 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35772024-09-16T14:48:27.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 09b53db5-32e3-4448-b389-45eb905848b5 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35782024-09-16T14:48:27.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 09b53db5-32e3-4448-b389-45eb905848b5 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35792024-09-16T14:48:28.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a0ed573a-d460-42a5-9431-953d421f93e0 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35802024-09-16T14:48:28.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a0ed573a-d460-42a5-9431-953d421f93e0 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35812024-09-16T14:48:28.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a0ed573a-d460-42a5-9431-953d421f93e0 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35822024-09-16T14:48:29.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = bc99072f-2bf2-47a7-8baa-541eef23c7e3 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35832024-09-16T14:48:29.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = bc99072f-2bf2-47a7-8baa-541eef23c7e3 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35842024-09-16T14:48:29.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = bc99072f-2bf2-47a7-8baa-541eef23c7e3 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35852024-09-16T14:48:30.382ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:35413
35862024-09-16T14:48:30.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35413 req_id = 6fc4bff5-6ff9-4469-a1cb-6ecdc6fccef9 roles = RoleSet { roles: {} } uri = /metrics/producers
35872024-09-16T14:48:30.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35413 req_id = 6fc4bff5-6ff9-4469-a1cb-6ecdc6fccef9 resource = Database result = Ok(()) uri = /metrics/producers
35882024-09-16T14:48:30.416ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d9cae32d-8e84-4f97-9d87-f815a97563b7
35892024-09-16T14:48:30.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35413 req_id = 6fc4bff5-6ff9-4469-a1cb-6ecdc6fccef9 roles = RoleSet { roles: {} } uri = /metrics/producers
35902024-09-16T14:48:30.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35413 req_id = 6fc4bff5-6ff9-4469-a1cb-6ecdc6fccef9 resource = Database result = Ok(()) uri = /metrics/producers
35912024-09-16T14:48:30.453ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 uri = http://[fd00:1122:3344:101::d]:12223/producers
35922024-09-16T14:48:30.454ZDEBGnexus: client response oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3b676cd8-1f5f-451b-874a-4658cdcbb7aa", "date": "Mon, 16 Sep 2024 14:48:30 GMT"} })
35932024-09-16T14:48:30.454ZINFOnexus: assigned collector to new producer collector_id = d9cae32d-8e84-4f97-9d87-f815a97563b7 file = nexus/src/app/oximeter.rs:125 producer_id = f26461d2-04fe-40aa-80c2-1eb0bc461628
35942024-09-16T14:48:30.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 73906 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35413 req_id = 6fc4bff5-6ff9-4469-a1cb-6ecdc6fccef9 response_code = 201 uri = /metrics/producers
35952024-09-16T14:48:30.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8c0e097d-2f39-4c4c-a284-4b80f9ff5dd0 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35962024-09-16T14:48:30.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8c0e097d-2f39-4c4c-a284-4b80f9ff5dd0 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35972024-09-16T14:48:30.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8c0e097d-2f39-4c4c-a284-4b80f9ff5dd0 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
35982024-09-16T14:48:31.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
35992024-09-16T14:48:31.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
36002024-09-16T14:48:31.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36012024-09-16T14:48:31.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36022024-09-16T14:48:31.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36032024-09-16T14:48:31.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36042024-09-16T14:48:31.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36052024-09-16T14:48:31.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36062024-09-16T14:48:31.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36072024-09-16T14:48:31.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36082024-09-16T14:48:31.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36092024-09-16T14:48:31.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36102024-09-16T14:48:31.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36112024-09-16T14:48:31.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
36122024-09-16T14:48:31.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36132024-09-16T14:48:31.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36142024-09-16T14:48:31.574ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
36152024-09-16T14:48:31.574ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.579863ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
36162024-09-16T14:48:31.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36172024-09-16T14:48:31.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36182024-09-16T14:48:31.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.256423ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36192024-09-16T14:48:31.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7369c20d-65cc-40fe-9cfd-105790b4898a roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36202024-09-16T14:48:31.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7369c20d-65cc-40fe-9cfd-105790b4898a resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36212024-09-16T14:48:31.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1771 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7369c20d-65cc-40fe-9cfd-105790b4898a response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36222024-09-16T14:48:32.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3a459c70-f799-4683-a24c-c38507cb855a roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36232024-09-16T14:48:32.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3a459c70-f799-4683-a24c-c38507cb855a resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36242024-09-16T14:48:32.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3a459c70-f799-4683-a24c-c38507cb855a response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36252024-09-16T14:48:33.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 79e8b8a0-5a25-4a6e-96cf-94ef59bfd4e9 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36262024-09-16T14:48:33.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 79e8b8a0-5a25-4a6e-96cf-94ef59bfd4e9 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36272024-09-16T14:48:33.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 79e8b8a0-5a25-4a6e-96cf-94ef59bfd4e9 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36282024-09-16T14:48:34.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 1aa14f83-b46c-40ca-8354-b66d11e5df79 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36292024-09-16T14:48:34.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 1aa14f83-b46c-40ca-8354-b66d11e5df79 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36302024-09-16T14:48:34.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 1aa14f83-b46c-40ca-8354-b66d11e5df79 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36312024-09-16T14:48:35.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5fd11df8-e156-49ba-90e1-6455350aea22 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36322024-09-16T14:48:35.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5fd11df8-e156-49ba-90e1-6455350aea22 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36332024-09-16T14:48:35.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5fd11df8-e156-49ba-90e1-6455350aea22 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36342024-09-16T14:48:35.852ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1346 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = d29cdd9d-db07-4234-8cae-34f045a2bc7b response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
36352024-09-16T14:48:36.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 79001f7e-576e-4120-a57c-8b289338467a roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36362024-09-16T14:48:36.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 79001f7e-576e-4120-a57c-8b289338467a resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36372024-09-16T14:48:36.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 79001f7e-576e-4120-a57c-8b289338467a response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36382024-09-16T14:48:37.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5600105c-674c-4264-94a8-d4c4dbb1b718 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36392024-09-16T14:48:37.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5600105c-674c-4264-94a8-d4c4dbb1b718 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36402024-09-16T14:48:37.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5600105c-674c-4264-94a8-d4c4dbb1b718 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36412024-09-16T14:48:38.546ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:37446
36422024-09-16T14:48:38.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37446 req_id = c3470487-a7a7-480b-b56e-f5ec453a6c0c roles = RoleSet { roles: {} } uri = /metrics/producers
36432024-09-16T14:48:38.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37446 req_id = c3470487-a7a7-480b-b56e-f5ec453a6c0c resource = Database result = Ok(()) uri = /metrics/producers
36442024-09-16T14:48:38.580ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d9cae32d-8e84-4f97-9d87-f815a97563b7
36452024-09-16T14:48:38.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37446 req_id = c3470487-a7a7-480b-b56e-f5ec453a6c0c roles = RoleSet { roles: {} } uri = /metrics/producers
36462024-09-16T14:48:38.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37446 req_id = c3470487-a7a7-480b-b56e-f5ec453a6c0c resource = Database result = Ok(()) uri = /metrics/producers
36472024-09-16T14:48:38.614ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 uri = http://[fd00:1122:3344:101::d]:12223/producers
36482024-09-16T14:48:38.614ZDEBGnexus: client response oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a316148b-7634-4581-a7ff-229e8de73e33", "date": "Mon, 16 Sep 2024 14:48:38 GMT"} })
36492024-09-16T14:48:38.614ZINFOnexus: assigned collector to new producer collector_id = d9cae32d-8e84-4f97-9d87-f815a97563b7 file = nexus/src/app/oximeter.rs:125 producer_id = 3a79bcd7-ea65-43ad-adb5-6672a26d233e
36502024-09-16T14:48:38.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 69554 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37446 req_id = c3470487-a7a7-480b-b56e-f5ec453a6c0c response_code = 201 uri = /metrics/producers
36512024-09-16T14:48:38.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 416c7d07-fbc7-472b-9b7a-6d3c0d547f46 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36522024-09-16T14:48:38.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 416c7d07-fbc7-472b-9b7a-6d3c0d547f46 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36532024-09-16T14:48:38.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 416c7d07-fbc7-472b-9b7a-6d3c0d547f46 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36542024-09-16T14:48:39.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e99cb53d-2a41-4bb5-8194-526e19c937aa roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36552024-09-16T14:48:39.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e99cb53d-2a41-4bb5-8194-526e19c937aa resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36562024-09-16T14:48:39.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e99cb53d-2a41-4bb5-8194-526e19c937aa response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36572024-09-16T14:48:40.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 22a96e72-c6c5-4e48-b06c-77e03aa32360 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36582024-09-16T14:48:40.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 22a96e72-c6c5-4e48-b06c-77e03aa32360 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36592024-09-16T14:48:40.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 22a96e72-c6c5-4e48-b06c-77e03aa32360 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36602024-09-16T14:48:41.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
36612024-09-16T14:48:41.555ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36622024-09-16T14:48:41.555ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
36632024-09-16T14:48:41.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36642024-09-16T14:48:41.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36652024-09-16T14:48:41.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36662024-09-16T14:48:41.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36672024-09-16T14:48:41.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36682024-09-16T14:48:41.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36692024-09-16T14:48:41.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36702024-09-16T14:48:41.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36712024-09-16T14:48:41.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36722024-09-16T14:48:41.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36732024-09-16T14:48:41.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
36742024-09-16T14:48:41.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36752024-09-16T14:48:41.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36762024-09-16T14:48:41.576ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
36772024-09-16T14:48:41.576ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.594492ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
36782024-09-16T14:48:41.586ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36792024-09-16T14:48:41.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36802024-09-16T14:48:41.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.256321ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36812024-09-16T14:48:41.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 24e26d5d-7908-41a1-8b61-3d8b278f74ce roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36822024-09-16T14:48:41.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 24e26d5d-7908-41a1-8b61-3d8b278f74ce resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36832024-09-16T14:48:41.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 24e26d5d-7908-41a1-8b61-3d8b278f74ce response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36842024-09-16T14:48:42.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 1a2a53c4-a47c-4fc8-9568-a785bcb4380d roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36852024-09-16T14:48:42.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 1a2a53c4-a47c-4fc8-9568-a785bcb4380d resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36862024-09-16T14:48:42.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 1a2a53c4-a47c-4fc8-9568-a785bcb4380d response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36872024-09-16T14:48:44.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3148a41c-0f5a-4e47-b550-3cebf04158c9 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36882024-09-16T14:48:44.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3148a41c-0f5a-4e47-b550-3cebf04158c9 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36892024-09-16T14:48:44.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3148a41c-0f5a-4e47-b550-3cebf04158c9 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36902024-09-16T14:48:45.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 38f15305-fe00-4cca-9373-68274e5d6632 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36912024-09-16T14:48:45.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 38f15305-fe00-4cca-9373-68274e5d6632 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36922024-09-16T14:48:45.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 38f15305-fe00-4cca-9373-68274e5d6632 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36932024-09-16T14:48:45.852ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1466 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = 26c3cf9c-21f6-442a-b36f-d1ecaef79eaa response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
36942024-09-16T14:48:46.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4dcaea10-45e4-47ad-80c2-030bb634816d roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36952024-09-16T14:48:46.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4dcaea10-45e4-47ad-80c2-030bb634816d resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36962024-09-16T14:48:46.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4dcaea10-45e4-47ad-80c2-030bb634816d response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36972024-09-16T14:48:47.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c7838ebd-879d-4b07-95e4-77d62d600d70 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36982024-09-16T14:48:47.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c7838ebd-879d-4b07-95e4-77d62d600d70 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
36992024-09-16T14:48:47.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c7838ebd-879d-4b07-95e4-77d62d600d70 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
37002024-09-16T14:48:48.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 585cb866-654b-4923-8510-a57ef385eed1 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
37012024-09-16T14:48:48.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 585cb866-654b-4923-8510-a57ef385eed1 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
37022024-09-16T14:48:48.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 585cb866-654b-4923-8510-a57ef385eed1 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
37032024-09-16T14:48:49.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3a4b53e9-8543-40dd-9d00-174263c946d7 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
37042024-09-16T14:48:49.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3a4b53e9-8543-40dd-9d00-174263c946d7 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
37052024-09-16T14:48:49.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3a4b53e9-8543-40dd-9d00-174263c946d7 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
37062024-09-16T14:48:50.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c3f04b91-8c88-4024-a12f-2bddb883d3e9 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
37072024-09-16T14:48:50.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c3f04b91-8c88-4024-a12f-2bddb883d3e9 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
37082024-09-16T14:48:50.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c3f04b91-8c88-4024-a12f-2bddb883d3e9 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
37092024-09-16T14:48:51.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 46919ed9-ad22-46f2-94b7-dc5a02592a2f roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
37102024-09-16T14:48:51.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 46919ed9-ad22-46f2-94b7-dc5a02592a2f resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
37112024-09-16T14:48:51.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2619 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 46919ed9-ad22-46f2-94b7-dc5a02592a2f response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
37122024-09-16T14:48:51.554ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
37132024-09-16T14:48:51.554ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
37142024-09-16T14:48:51.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37152024-09-16T14:48:51.554ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37162024-09-16T14:48:51.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
37172024-09-16T14:48:51.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
37182024-09-16T14:48:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37192024-09-16T14:48:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37202024-09-16T14:48:51.554ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
37212024-09-16T14:48:51.554ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37222024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
37232024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
37242024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
37252024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37262024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
37272024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37282024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
37292024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37302024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
37312024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37322024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
37332024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37342024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
37352024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37362024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37372024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
37382024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
37392024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
37402024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
37412024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37422024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37432024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37442024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
37452024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
37462024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37472024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37482024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37492024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37502024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
37512024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
37522024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
37532024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37542024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37552024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37562024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
37572024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37582024-09-16T14:48:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37592024-09-16T14:48:51.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37602024-09-16T14:48:51.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
37612024-09-16T14:48:51.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37622024-09-16T14:48:51.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37632024-09-16T14:48:51.558ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37642024-09-16T14:48:51.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
37652024-09-16T14:48:51.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37662024-09-16T14:48:51.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37672024-09-16T14:48:51.560ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24220, tv_nsec: 518758617 } })
37682024-09-16T14:48:51.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37692024-09-16T14:48:51.560ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37702024-09-16T14:48:51.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37712024-09-16T14:48:51.561ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
37722024-09-16T14:48:51.564ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 9.313067ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
37732024-09-16T14:48:51.565ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24220, tv_nsec: 523996906 } })
37742024-09-16T14:48:51.565ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37752024-09-16T14:48:51.566ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
37762024-09-16T14:48:51.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
37772024-09-16T14:48:51.567ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37782024-09-16T14:48:51.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37792024-09-16T14:48:51.570ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37802024-09-16T14:48:51.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37812024-09-16T14:48:51.571ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24220, tv_nsec: 529836698 } })
37822024-09-16T14:48:51.572ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
37832024-09-16T14:48:51.590ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37842024-09-16T14:48:51.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37852024-09-16T14:48:51.593ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37862024-09-16T14:48:51.594ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37872024-09-16T14:48:51.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37882024-09-16T14:48:51.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37892024-09-16T14:48:51.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37902024-09-16T14:48:51.599ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37912024-09-16T14:48:51.599ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37922024-09-16T14:48:51.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37932024-09-16T14:48:51.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37942024-09-16T14:48:51.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37952024-09-16T14:48:51.600ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37962024-09-16T14:48:51.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37972024-09-16T14:48:51.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37982024-09-16T14:48:51.601ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
37992024-09-16T14:48:51.601ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
38002024-09-16T14:48:51.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38012024-09-16T14:48:51.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38022024-09-16T14:48:51.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38032024-09-16T14:48:51.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38042024-09-16T14:48:51.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38052024-09-16T14:48:51.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38062024-09-16T14:48:51.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38072024-09-16T14:48:51.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38082024-09-16T14:48:51.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38092024-09-16T14:48:51.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38102024-09-16T14:48:51.608ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38112024-09-16T14:48:51.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38122024-09-16T14:48:51.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.005077ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
38132024-09-16T14:48:51.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38142024-09-16T14:48:51.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
38152024-09-16T14:48:51.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38162024-09-16T14:48:51.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38172024-09-16T14:48:51.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38182024-09-16T14:48:51.613ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:539 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
38192024-09-16T14:48:51.613ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 58.447614ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
38202024-09-16T14:48:51.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38212024-09-16T14:48:51.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38222024-09-16T14:48:51.614ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38232024-09-16T14:48:51.614ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 59.501884ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
38242024-09-16T14:48:51.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38252024-09-16T14:48:51.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38262024-09-16T14:48:51.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
38272024-09-16T14:48:51.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38282024-09-16T14:48:51.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38292024-09-16T14:48:51.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 81.685976ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
38302024-09-16T14:48:51.641ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38312024-09-16T14:48:51.642ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
38322024-09-16T14:48:51.642ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 87.289592ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
38332024-09-16T14:48:51.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38342024-09-16T14:48:51.644ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38352024-09-16T14:48:51.645ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 89.678298ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
38362024-09-16T14:48:51.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38372024-09-16T14:48:51.647ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38382024-09-16T14:48:51.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f26461d2-04fe-40aa-80c2-1eb0bc461628, lookup_type: ById(f26461d2-04fe-40aa-80c2-1eb0bc461628) } result = Ok(())
38392024-09-16T14:48:51.651ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38402024-09-16T14:48:51.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38412024-09-16T14:48:51.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.269343ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
38422024-09-16T14:48:51.653ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 98.843413ms iteration = 16 status = 0
38432024-09-16T14:48:51.653ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
38442024-09-16T14:48:51.653ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
38452024-09-16T14:48:51.653ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38462024-09-16T14:48:51.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38472024-09-16T14:48:51.658ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
38482024-09-16T14:48:51.658ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38492024-09-16T14:48:51.658ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c33c03d4-8379-4c94-83f6-d73a10111d1c", "content-length": "26", "date": "Mon, 16 Sep 2024 14:48:50 GMT"} })
38502024-09-16T14:48:51.658ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38512024-09-16T14:48:51.660ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38522024-09-16T14:48:51.662ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 107.475997ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38532024-09-16T14:48:51.701ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
38542024-09-16T14:48:51.701ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:226 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
38552024-09-16T14:48:51.701ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 145.794227ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
38562024-09-16T14:48:51.716ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38572024-09-16T14:48:51.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38582024-09-16T14:48:51.727ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 172.809552ms iteration = 19 status = {"physical_disks_added":0}
38592024-09-16T14:48:51.741ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
38602024-09-16T14:48:51.741ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38612024-09-16T14:48:51.742ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2aaa77b0-c04c-4975-98ac-3ed3d65540e0", "content-length": "26", "date": "Mon, 16 Sep 2024 14:48:50 GMT"} })
38622024-09-16T14:48:51.742ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38632024-09-16T14:48:51.744ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38642024-09-16T14:48:51.750ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38652024-09-16T14:48:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38662024-09-16T14:48:51.764ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 zone_address = fd00:1122:3344:101::2
38672024-09-16T14:48:51.764ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38682024-09-16T14:48:51.764ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2078186c-2a43-4785-b521-e5c1f8691656", "content-length": "26", "date": "Mon, 16 Sep 2024 14:48:51 GMT"} })
38692024-09-16T14:48:51.764ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38702024-09-16T14:48:51.766ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
38712024-09-16T14:48:51.766ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
38722024-09-16T14:48:51.767ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "58a66f96-056e-4602-8057-7c688c5ece0d", "content-length": "2", "date": "Mon, 16 Sep 2024 14:48:51 GMT"} })
38732024-09-16T14:48:51.768ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38742024-09-16T14:48:51.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38752024-09-16T14:48:51.770ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 216.100466ms iteration = 16 status = null
38762024-09-16T14:48:51.777ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38772024-09-16T14:48:51.778ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38782024-09-16T14:48:51.778ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38792024-09-16T14:48:51.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38802024-09-16T14:48:51.780ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38812024-09-16T14:48:51.782ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38822024-09-16T14:48:51.782ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38832024-09-16T14:48:51.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38842024-09-16T14:48:51.896ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38852024-09-16T14:48:51.897ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "035992d7-eab1-4527-acda-7939464d4d95", "content-length": "372", "date": "Mon, 16 Sep 2024 14:48:51 GMT"} })
38862024-09-16T14:48:51.897ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38872024-09-16T14:48:51.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38882024-09-16T14:48:51.908ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
38892024-09-16T14:48:51.908ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c55689e2-bf5e-4e22-86e0-ec4c560db43b", "content-length": "691", "date": "Mon, 16 Sep 2024 14:48:51 GMT"} })
38902024-09-16T14:48:51.908ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
38912024-09-16T14:48:51.908ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
38922024-09-16T14:48:51.908ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
38932024-09-16T14:48:51.909ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 354.215747ms iteration = 17 status = {}
38942024-09-16T14:48:51.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38952024-09-16T14:48:51.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38962024-09-16T14:48:51.913ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38972024-09-16T14:48:51.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38982024-09-16T14:48:51.916ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38992024-09-16T14:48:51.916ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2eed183f-be2a-4b9e-b714-63cc56e2939d", "date": "Mon, 16 Sep 2024 14:48:51 GMT"} })
39002024-09-16T14:48:51.918ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 363.263099ms iteration = 18 status = {}
39012024-09-16T14:48:51.928ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 373.104507ms iteration = 16 status = {}
39022024-09-16T14:48:51.971ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39032024-09-16T14:48:51.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39042024-09-16T14:48:51.974ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 94d6770e-63ed-455d-aa9f-8ad47c66c84e, rack_id: 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bc13c6ca-2923-40a0-a45c-bfa5d94842d2) } rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0
39052024-09-16T14:48:51.974ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39062024-09-16T14:48:51.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39072024-09-16T14:48:51.983ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
39082024-09-16T14:48:51.983ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cbde273b-0a44-4d7e-810a-cd141b1c1f36", "content-length": "121", "date": "Mon, 16 Sep 2024 14:48:51 GMT"} })
39092024-09-16T14:48:51.984ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
39102024-09-16T14:48:51.984ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bc13c6ca-2923-40a0-a45c-bfa5d94842d2
39112024-09-16T14:48:51.984ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
39122024-09-16T14:48:51.984ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
39132024-09-16T14:48:51.984ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {}
39142024-09-16T14:48:51.984ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {}
39152024-09-16T14:48:51.984ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
39162024-09-16T14:48:51.984ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39172024-09-16T14:48:51.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39182024-09-16T14:48:51.986ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
39192024-09-16T14:48:51.986ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8760927c-b709-4382-990f-509579f66851", "content-length": "2", "date": "Mon, 16 Sep 2024 14:48:51 GMT"} })
39202024-09-16T14:48:51.986ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
39212024-09-16T14:48:51.986ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ff3e304f-835a-430d-83a3-e0299d71678d", "content-length": "52", "date": "Mon, 16 Sep 2024 14:48:51 GMT"} })
39222024-09-16T14:48:51.986ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0
39232024-09-16T14:48:51.986ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
39242024-09-16T14:48:52.132ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b474756a-d463-4902-870e-93eddca74840", "date": "Mon, 16 Sep 2024 14:48:51 GMT"} })
39252024-09-16T14:48:52.132ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch = Switch0
39262024-09-16T14:48:52.132ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
39272024-09-16T14:48:52.132ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e6363e00-4f9d-463b-b0c1-be1d84811841", "content-length": "667", "date": "Mon, 16 Sep 2024 14:48:51 GMT"} })
39282024-09-16T14:48:52.132ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39292024-09-16T14:48:52.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39302024-09-16T14:48:52.136ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39312024-09-16T14:48:52.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39322024-09-16T14:48:52.139ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39332024-09-16T14:48:52.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39342024-09-16T14:48:52.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39352024-09-16T14:48:52.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39362024-09-16T14:48:52.147ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 592.536256ms iteration = 16 status = {}
39372024-09-16T14:48:52.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e3772bb1-7b4c-4403-bc14-ce8787e6d856 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39382024-09-16T14:48:52.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e3772bb1-7b4c-4403-bc14-ce8787e6d856 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39392024-09-16T14:48:52.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e3772bb1-7b4c-4403-bc14-ce8787e6d856 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39402024-09-16T14:48:53.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = ba5f11af-de8f-4351-95d2-7c63ea3e7370 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39412024-09-16T14:48:53.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = ba5f11af-de8f-4351-95d2-7c63ea3e7370 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39422024-09-16T14:48:53.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = ba5f11af-de8f-4351-95d2-7c63ea3e7370 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39432024-09-16T14:48:54.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 13299b09-cfd8-4302-86c1-5866efe88b41 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39442024-09-16T14:48:54.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 13299b09-cfd8-4302-86c1-5866efe88b41 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39452024-09-16T14:48:54.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2920 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 13299b09-cfd8-4302-86c1-5866efe88b41 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39462024-09-16T14:48:55.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 018642c2-0382-42e2-aff2-efa9b95e6e98 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39472024-09-16T14:48:55.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 018642c2-0382-42e2-aff2-efa9b95e6e98 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39482024-09-16T14:48:55.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 018642c2-0382-42e2-aff2-efa9b95e6e98 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39492024-09-16T14:48:55.852ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1324 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = 491e3a14-de37-4607-9e2c-a93b9cd87030 response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
39502024-09-16T14:48:55.854ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
39512024-09-16T14:48:55.854ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
39522024-09-16T14:48:55.885ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
39532024-09-16T14:48:55.885ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:45078
39542024-09-16T14:48:55.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45078 req_id = 6c00315b-0d7f-48f1-b71e-b34ed7230e24 roles = RoleSet { roles: {} } uri = /metrics/producers
39552024-09-16T14:48:55.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45078 req_id = 6c00315b-0d7f-48f1-b71e-b34ed7230e24 resource = Database result = Ok(()) uri = /metrics/producers
39562024-09-16T14:48:55.919ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d9cae32d-8e84-4f97-9d87-f815a97563b7
39572024-09-16T14:48:55.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45078 req_id = 6c00315b-0d7f-48f1-b71e-b34ed7230e24 roles = RoleSet { roles: {} } uri = /metrics/producers
39582024-09-16T14:48:55.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45078 req_id = 6c00315b-0d7f-48f1-b71e-b34ed7230e24 resource = Database result = Ok(()) uri = /metrics/producers
39592024-09-16T14:48:55.951ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 uri = http://[fd00:1122:3344:101::d]:12223/producers
39602024-09-16T14:48:55.952ZDEBGnexus: client response oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a0baf264-944a-4cab-afb6-86c509ec7e71", "date": "Mon, 16 Sep 2024 14:48:55 GMT"} })
39612024-09-16T14:48:55.952ZINFOnexus: assigned collector to new producer collector_id = d9cae32d-8e84-4f97-9d87-f815a97563b7 file = nexus/src/app/oximeter.rs:125 producer_id = 1ee13a98-c783-4c45-9593-448411671260
39622024-09-16T14:48:55.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 69438 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45078 req_id = 6c00315b-0d7f-48f1-b71e-b34ed7230e24 response_code = 201 uri = /metrics/producers
39632024-09-16T14:48:55.955ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "6c00315b-0d7f-48f1-b71e-b34ed7230e24", "content-length": "41", "date": "Mon, 16 Sep 2024 14:48:55 GMT"} })
39642024-09-16T14:48:55.956ZDEBGnexus (producer-registration-task): registered with nexus successfully
39652024-09-16T14:48:55.956ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
39662024-09-16T14:48:56.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4c6b47de-d7ee-4467-9803-fd807bd58d31 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39672024-09-16T14:48:56.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4c6b47de-d7ee-4467-9803-fd807bd58d31 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39682024-09-16T14:48:56.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4c6b47de-d7ee-4467-9803-fd807bd58d31 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39692024-09-16T14:48:57.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4fb16624-4ed5-4f48-8647-2f909e3db87d roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39702024-09-16T14:48:57.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4fb16624-4ed5-4f48-8647-2f909e3db87d resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39712024-09-16T14:48:57.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2553 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4fb16624-4ed5-4f48-8647-2f909e3db87d response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39722024-09-16T14:48:58.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8eaef861-0bd6-4c80-bb6e-6f8b70f9cc26 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39732024-09-16T14:48:58.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8eaef861-0bd6-4c80-bb6e-6f8b70f9cc26 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39742024-09-16T14:48:58.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8eaef861-0bd6-4c80-bb6e-6f8b70f9cc26 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39752024-09-16T14:48:59.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d3fecc01-483a-49c3-93ba-68b31f8588c2 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39762024-09-16T14:48:59.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d3fecc01-483a-49c3-93ba-68b31f8588c2 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39772024-09-16T14:48:59.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d3fecc01-483a-49c3-93ba-68b31f8588c2 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39782024-09-16T14:49:00.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3bf80b8c-d0aa-418f-aab4-539a02709197 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39792024-09-16T14:49:00.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3bf80b8c-d0aa-418f-aab4-539a02709197 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39802024-09-16T14:49:00.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3bf80b8c-d0aa-418f-aab4-539a02709197 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39812024-09-16T14:49:01.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 1efdd140-0050-4d06-b4fb-d53ae2a54fe2 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39822024-09-16T14:49:01.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 1efdd140-0050-4d06-b4fb-d53ae2a54fe2 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39832024-09-16T14:49:01.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 1efdd140-0050-4d06-b4fb-d53ae2a54fe2 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
39842024-09-16T14:49:01.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
39852024-09-16T14:49:01.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39862024-09-16T14:49:01.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
39872024-09-16T14:49:01.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39882024-09-16T14:49:01.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39892024-09-16T14:49:01.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39902024-09-16T14:49:01.556ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39912024-09-16T14:49:01.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39922024-09-16T14:49:01.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39932024-09-16T14:49:01.558ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.327652ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39942024-09-16T14:49:01.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39952024-09-16T14:49:01.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39962024-09-16T14:49:01.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39972024-09-16T14:49:01.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39982024-09-16T14:49:01.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39992024-09-16T14:49:01.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40002024-09-16T14:49:01.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
40012024-09-16T14:49:01.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40022024-09-16T14:49:01.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40032024-09-16T14:49:01.573ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
40042024-09-16T14:49:01.573ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.600254ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
40052024-09-16T14:49:02.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 23731b7c-e433-45be-b61e-1b839c314c48 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40062024-09-16T14:49:02.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 23731b7c-e433-45be-b61e-1b839c314c48 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40072024-09-16T14:49:02.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 23731b7c-e433-45be-b61e-1b839c314c48 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40082024-09-16T14:49:03.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 50eb78b0-ccb0-4908-8159-66c107f66d21 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40092024-09-16T14:49:03.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 50eb78b0-ccb0-4908-8159-66c107f66d21 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40102024-09-16T14:49:03.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 50eb78b0-ccb0-4908-8159-66c107f66d21 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40112024-09-16T14:49:04.315ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:51591
40122024-09-16T14:49:04.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51591 req_id = 1532c427-16e6-4f72-8ba4-f41bf418cf63 roles = RoleSet { roles: {} } uri = /metrics/producers
40132024-09-16T14:49:04.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51591 req_id = 1532c427-16e6-4f72-8ba4-f41bf418cf63 resource = Database result = Ok(()) uri = /metrics/producers
40142024-09-16T14:49:04.349ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d9cae32d-8e84-4f97-9d87-f815a97563b7
40152024-09-16T14:49:04.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51591 req_id = 1532c427-16e6-4f72-8ba4-f41bf418cf63 roles = RoleSet { roles: {} } uri = /metrics/producers
40162024-09-16T14:49:04.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51591 req_id = 1532c427-16e6-4f72-8ba4-f41bf418cf63 resource = Database result = Ok(()) uri = /metrics/producers
40172024-09-16T14:49:04.385ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 uri = http://[fd00:1122:3344:101::d]:12223/producers
40182024-09-16T14:49:04.386ZDEBGnexus: client response oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "82546a10-1b06-480f-9e32-d64742cc2a1e", "date": "Mon, 16 Sep 2024 14:49:04 GMT"} })
40192024-09-16T14:49:04.386ZINFOnexus: assigned collector to new producer collector_id = d9cae32d-8e84-4f97-9d87-f815a97563b7 file = nexus/src/app/oximeter.rs:125 producer_id = fe307d27-cbdb-46ee-92ad-6b959ef3bf4b
40202024-09-16T14:49:04.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 72177 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51591 req_id = 1532c427-16e6-4f72-8ba4-f41bf418cf63 response_code = 201 uri = /metrics/producers
40212024-09-16T14:49:04.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 84ed76a6-b0e7-42b0-81e8-526b3e2be8c2 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40222024-09-16T14:49:04.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 84ed76a6-b0e7-42b0-81e8-526b3e2be8c2 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40232024-09-16T14:49:04.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 84ed76a6-b0e7-42b0-81e8-526b3e2be8c2 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40242024-09-16T14:49:05.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a8f693fc-d4a5-4523-8a48-d05b1ed52405 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40252024-09-16T14:49:05.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a8f693fc-d4a5-4523-8a48-d05b1ed52405 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40262024-09-16T14:49:05.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a8f693fc-d4a5-4523-8a48-d05b1ed52405 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40272024-09-16T14:49:05.955ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1374 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = 0bd4d406-cb20-425e-bfd4-ba032216f765 response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
40282024-09-16T14:49:06.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a7e0e8a5-ea58-4319-818f-fab2d7c8992d roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40292024-09-16T14:49:06.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a7e0e8a5-ea58-4319-818f-fab2d7c8992d resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40302024-09-16T14:49:06.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a7e0e8a5-ea58-4319-818f-fab2d7c8992d response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40312024-09-16T14:49:06.941ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:43950
40322024-09-16T14:49:06.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43950 req_id = d992567f-2c19-4d31-ace2-33a6b1379982 roles = RoleSet { roles: {} } uri = /metrics/producers
40332024-09-16T14:49:06.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43950 req_id = d992567f-2c19-4d31-ace2-33a6b1379982 resource = Database result = Ok(()) uri = /metrics/producers
40342024-09-16T14:49:06.975ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d9cae32d-8e84-4f97-9d87-f815a97563b7
40352024-09-16T14:49:06.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43950 req_id = d992567f-2c19-4d31-ace2-33a6b1379982 roles = RoleSet { roles: {} } uri = /metrics/producers
40362024-09-16T14:49:06.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43950 req_id = d992567f-2c19-4d31-ace2-33a6b1379982 resource = Database result = Ok(()) uri = /metrics/producers
40372024-09-16T14:49:06.983ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 uri = http://[fd00:1122:3344:101::d]:12223/producers
40382024-09-16T14:49:06.983ZDEBGnexus: client response oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "aa51a831-23dc-48ea-82ba-2077a308a9b0", "date": "Mon, 16 Sep 2024 14:49:06 GMT"} })
40392024-09-16T14:49:06.983ZINFOnexus: assigned collector to new producer collector_id = d9cae32d-8e84-4f97-9d87-f815a97563b7 file = nexus/src/app/oximeter.rs:125 producer_id = 04c7daf0-9be9-4202-8f00-60f03c7b20ce
40402024-09-16T14:49:06.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 42744 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43950 req_id = d992567f-2c19-4d31-ace2-33a6b1379982 response_code = 201 uri = /metrics/producers
40412024-09-16T14:49:07.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3a94b05e-6afe-4e20-a2e5-24afee04df95 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40422024-09-16T14:49:07.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3a94b05e-6afe-4e20-a2e5-24afee04df95 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40432024-09-16T14:49:07.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3a94b05e-6afe-4e20-a2e5-24afee04df95 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40442024-09-16T14:49:08.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 64f471f6-4fe6-418f-ab5c-f17c8ee526fa roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40452024-09-16T14:49:08.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 64f471f6-4fe6-418f-ab5c-f17c8ee526fa resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40462024-09-16T14:49:08.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 64f471f6-4fe6-418f-ab5c-f17c8ee526fa response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40472024-09-16T14:49:09.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 10f57341-003a-47ac-986a-3365518af052 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40482024-09-16T14:49:09.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 10f57341-003a-47ac-986a-3365518af052 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40492024-09-16T14:49:09.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 10f57341-003a-47ac-986a-3365518af052 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40502024-09-16T14:49:10.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 98f3065b-8bee-4dfe-9697-cd76d047ce7b roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40512024-09-16T14:49:10.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 98f3065b-8bee-4dfe-9697-cd76d047ce7b resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40522024-09-16T14:49:10.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1814 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 98f3065b-8bee-4dfe-9697-cd76d047ce7b response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40532024-09-16T14:49:11.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
40542024-09-16T14:49:11.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
40552024-09-16T14:49:11.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40562024-09-16T14:49:11.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40572024-09-16T14:49:11.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40582024-09-16T14:49:11.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40592024-09-16T14:49:11.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40602024-09-16T14:49:11.556ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40612024-09-16T14:49:11.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40622024-09-16T14:49:11.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40632024-09-16T14:49:11.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40642024-09-16T14:49:11.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40652024-09-16T14:49:11.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40662024-09-16T14:49:11.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40672024-09-16T14:49:11.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40682024-09-16T14:49:11.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
40692024-09-16T14:49:11.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40702024-09-16T14:49:11.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40712024-09-16T14:49:11.571ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
40722024-09-16T14:49:11.571ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.530784ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
40732024-09-16T14:49:11.589ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.454896ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40742024-09-16T14:49:11.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 9494c5ca-cba4-4dbe-8d48-17d2aaeb5e5f roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40752024-09-16T14:49:11.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 9494c5ca-cba4-4dbe-8d48-17d2aaeb5e5f resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40762024-09-16T14:49:11.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1665 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 9494c5ca-cba4-4dbe-8d48-17d2aaeb5e5f response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40772024-09-16T14:49:12.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = bbeb0eb9-9efd-4ea5-8057-6dc739f33525 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40782024-09-16T14:49:12.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = bbeb0eb9-9efd-4ea5-8057-6dc739f33525 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40792024-09-16T14:49:12.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = bbeb0eb9-9efd-4ea5-8057-6dc739f33525 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40802024-09-16T14:49:13.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 75f794cf-e949-465a-bfcb-23a7b71690d3 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40812024-09-16T14:49:13.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 75f794cf-e949-465a-bfcb-23a7b71690d3 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40822024-09-16T14:49:13.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2534 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 75f794cf-e949-465a-bfcb-23a7b71690d3 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40832024-09-16T14:49:14.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4ba5d6d5-b95e-48f0-86ff-c5085bde6491 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40842024-09-16T14:49:14.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4ba5d6d5-b95e-48f0-86ff-c5085bde6491 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40852024-09-16T14:49:14.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4ba5d6d5-b95e-48f0-86ff-c5085bde6491 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40862024-09-16T14:49:15.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = de84cc69-8aba-4973-b7cb-3fea9b9b156a roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40872024-09-16T14:49:15.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = de84cc69-8aba-4973-b7cb-3fea9b9b156a resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40882024-09-16T14:49:15.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = de84cc69-8aba-4973-b7cb-3fea9b9b156a response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40892024-09-16T14:49:15.955ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1246 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = fd9082a7-219e-451f-9610-167d77f0d858 response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
40902024-09-16T14:49:16.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 595f7a7d-31db-4491-a285-42bbe543a2ce roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40912024-09-16T14:49:16.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 595f7a7d-31db-4491-a285-42bbe543a2ce resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40922024-09-16T14:49:16.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2524 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 595f7a7d-31db-4491-a285-42bbe543a2ce response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40932024-09-16T14:49:17.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 29884b9c-65cd-46da-8d23-496ba5ba9b78 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40942024-09-16T14:49:17.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 29884b9c-65cd-46da-8d23-496ba5ba9b78 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40952024-09-16T14:49:17.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 29884b9c-65cd-46da-8d23-496ba5ba9b78 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40962024-09-16T14:49:18.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4e24f848-7358-4557-bb22-21e39178fe5d roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40972024-09-16T14:49:18.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4e24f848-7358-4557-bb22-21e39178fe5d resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40982024-09-16T14:49:18.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4e24f848-7358-4557-bb22-21e39178fe5d response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
40992024-09-16T14:49:19.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 64ab9e81-1ab2-471b-a19c-124957b261b3 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
41002024-09-16T14:49:19.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 64ab9e81-1ab2-471b-a19c-124957b261b3 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
41012024-09-16T14:49:19.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1974 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 64ab9e81-1ab2-471b-a19c-124957b261b3 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
41022024-09-16T14:49:20.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4d363f26-dfed-42e8-9c85-e8bbdfd97d8d roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
41032024-09-16T14:49:20.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4d363f26-dfed-42e8-9c85-e8bbdfd97d8d resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
41042024-09-16T14:49:20.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4d363f26-dfed-42e8-9c85-e8bbdfd97d8d response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
41052024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
41062024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
41072024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41082024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41092024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
41102024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41112024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
41122024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
41132024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41142024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
41152024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41162024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
41172024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41182024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
41192024-09-16T14:49:21.554ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
41202024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
41212024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
41222024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
41232024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
41242024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41252024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41262024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
41272024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
41282024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
41292024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
41302024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
41312024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41322024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
41332024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41342024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41352024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
41362024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
41372024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
41382024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41392024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
41402024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
41412024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41422024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
41432024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
41442024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
41452024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41462024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
41472024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
41482024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
41492024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
41502024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41512024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
41522024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
41532024-09-16T14:49:21.554ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
41542024-09-16T14:49:21.554ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-16 14:39:21.554622497 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
41552024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
41562024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
41572024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
41582024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
41592024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
41602024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41612024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41622024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
41632024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41642024-09-16T14:49:21.555ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2
41652024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.91\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2"}
41662024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41672024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41682024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41692024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41702024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41712024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41722024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41732024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
41742024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41752024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41762024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41772024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41782024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41792024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
41802024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
41812024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
41822024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41832024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41842024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
41852024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41862024-09-16T14:49:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
41872024-09-16T14:49:21.555ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("216291e2-64d0-4e57-82ea-84523304c97b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fcbfd0d4-0b48-4392-95df-b0bdb2c97118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fcbfd0d4-0b48-4392-95df-b0bdb2c97118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 24250, tv_nsec: 513898574 } })
41882024-09-16T14:49:21.555ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0839d410-88e5-4168-91a3-1340a5d7a912.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f93623c-a4f4-43d1-b285-fdbdeccdc7e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fc6cb4c7-5a91-4879-8aba-57c83b2f5553.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fc6cb4c7-5a91-4879-8aba-57c83b2f5553.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 24250, tv_nsec: 514089008 } })
41892024-09-16T14:49:21.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41902024-09-16T14:49:21.557ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.955757ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
41912024-09-16T14:49:21.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41922024-09-16T14:49:21.558ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
41932024-09-16T14:49:21.558ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.857634ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
41942024-09-16T14:49:21.558ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
41952024-09-16T14:49:21.558ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.953906ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
41962024-09-16T14:49:21.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41972024-09-16T14:49:21.559ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41982024-09-16T14:49:21.559ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24250, tv_nsec: 518409530 } })
41992024-09-16T14:49:21.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
42002024-09-16T14:49:21.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42012024-09-16T14:49:21.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42022024-09-16T14:49:21.561ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
42032024-09-16T14:49:21.563ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42042024-09-16T14:49:21.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
42052024-09-16T14:49:21.563ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42062024-09-16T14:49:21.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42072024-09-16T14:49:21.565ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42082024-09-16T14:49:21.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
42092024-09-16T14:49:21.566ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42102024-09-16T14:49:21.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42112024-09-16T14:49:21.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
42122024-09-16T14:49:21.568ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42132024-09-16T14:49:21.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
42142024-09-16T14:49:21.570ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42152024-09-16T14:49:21.570ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42162024-09-16T14:49:21.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42172024-09-16T14:49:21.572ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42182024-09-16T14:49:21.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42192024-09-16T14:49:21.572ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24250, tv_nsec: 531420618 } })
42202024-09-16T14:49:21.573ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
42212024-09-16T14:49:21.574ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42222024-09-16T14:49:21.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42232024-09-16T14:49:21.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42242024-09-16T14:49:21.579ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 24.553958ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
42252024-09-16T14:49:21.580ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-16 14:39:21.554622497 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
42262024-09-16T14:49:21.580ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 25.791831ms iteration = 9 status = {"expiration":"2024-09-16T14:39:21.554622497Z","pruned":[]}
42272024-09-16T14:49:21.582ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42282024-09-16T14:49:21.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42292024-09-16T14:49:21.585ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24250, tv_nsec: 544255002 } })
42302024-09-16T14:49:21.586ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
42312024-09-16T14:49:21.595ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42322024-09-16T14:49:21.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42332024-09-16T14:49:21.599ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:539 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
42342024-09-16T14:49:21.599ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 45.708261ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
42352024-09-16T14:49:21.612ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
42362024-09-16T14:49:21.612ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
42372024-09-16T14:49:21.612ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42382024-09-16T14:49:21.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42392024-09-16T14:49:21.612ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
42402024-09-16T14:49:21.612ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
42412024-09-16T14:49:21.612ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 58.480674ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
42422024-09-16T14:49:21.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.843751ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
42432024-09-16T14:49:21.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42442024-09-16T14:49:21.616ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
42452024-09-16T14:49:21.616ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
42462024-09-16T14:49:21.616ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42472024-09-16T14:49:21.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42482024-09-16T14:49:21.616ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42492024-09-16T14:49:21.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42502024-09-16T14:49:21.617ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42512024-09-16T14:49:21.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42522024-09-16T14:49:21.617ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42532024-09-16T14:49:21.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42542024-09-16T14:49:21.618ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42552024-09-16T14:49:21.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42562024-09-16T14:49:21.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42572024-09-16T14:49:21.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42582024-09-16T14:49:21.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42592024-09-16T14:49:21.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42602024-09-16T14:49:21.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42612024-09-16T14:49:21.621ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42622024-09-16T14:49:21.624ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
42632024-09-16T14:49:21.624ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42642024-09-16T14:49:21.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42652024-09-16T14:49:21.629ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42662024-09-16T14:49:21.629ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42672024-09-16T14:49:21.629ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42682024-09-16T14:49:21.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42692024-09-16T14:49:21.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42702024-09-16T14:49:21.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42712024-09-16T14:49:21.631ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.534008ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
42722024-09-16T14:49:21.632ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42732024-09-16T14:49:21.632ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42742024-09-16T14:49:21.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42752024-09-16T14:49:21.635ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42762024-09-16T14:49:21.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42772024-09-16T14:49:21.636ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42782024-09-16T14:49:21.637ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42792024-09-16T14:49:21.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
42802024-09-16T14:49:21.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42812024-09-16T14:49:21.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42822024-09-16T14:49:21.639ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
42832024-09-16T14:49:21.639ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
42842024-09-16T14:49:21.639ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 84.901288ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
42852024-09-16T14:49:21.639ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42862024-09-16T14:49:21.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42872024-09-16T14:49:21.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42882024-09-16T14:49:21.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42892024-09-16T14:49:21.644ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42902024-09-16T14:49:21.646ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
42912024-09-16T14:49:21.646ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
42922024-09-16T14:49:21.646ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
42932024-09-16T14:49:21.646ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42942024-09-16T14:49:21.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42952024-09-16T14:49:21.647ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42962024-09-16T14:49:21.647ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42972024-09-16T14:49:21.647ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42982024-09-16T14:49:21.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42992024-09-16T14:49:21.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43002024-09-16T14:49:21.648ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 93.929279ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43012024-09-16T14:49:21.648ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
43022024-09-16T14:49:21.648ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
43032024-09-16T14:49:21.648ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
43042024-09-16T14:49:21.648ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43052024-09-16T14:49:21.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43062024-09-16T14:49:21.649ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43072024-09-16T14:49:21.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43082024-09-16T14:49:21.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43092024-09-16T14:49:21.653ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43102024-09-16T14:49:21.653ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 99.129918ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
43112024-09-16T14:49:21.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43122024-09-16T14:49:21.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f26461d2-04fe-40aa-80c2-1eb0bc461628, lookup_type: ById(f26461d2-04fe-40aa-80c2-1eb0bc461628) } result = Ok(())
43132024-09-16T14:49:21.656ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
43142024-09-16T14:49:21.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43152024-09-16T14:49:21.656ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 102.40441ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
43162024-09-16T14:49:21.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43172024-09-16T14:49:21.657ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
43182024-09-16T14:49:21.657ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 01c7aafc-c1b7-42bb-a493-0c643f2e21db dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
43192024-09-16T14:49:21.657ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43202024-09-16T14:49:21.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43212024-09-16T14:49:21.659ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43222024-09-16T14:49:21.661ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 106.722813ms iteration = 17 status = 0
43232024-09-16T14:49:21.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43242024-09-16T14:49:21.664ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43252024-09-16T14:49:21.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43262024-09-16T14:49:21.666ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
43272024-09-16T14:49:21.666ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:226 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
43282024-09-16T14:49:21.666ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 111.796409ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
43292024-09-16T14:49:21.682ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43302024-09-16T14:49:21.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43312024-09-16T14:49:21.686ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 01c7aafc-c1b7-42bb-a493-0c643f2e21db dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
43322024-09-16T14:49:21.686ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
43332024-09-16T14:49:21.686ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-16 14:41:23.295040 UTC dns_group = internal generation = 1
43342024-09-16T14:49:21.686ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 132.160458ms iteration = 10 status = {"generation":1}
43352024-09-16T14:49:21.687ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 132.593215ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
43362024-09-16T14:49:21.690ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 135.766696ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
43372024-09-16T14:49:21.695ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43382024-09-16T14:49:21.700ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
43392024-09-16T14:49:21.700ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43402024-09-16T14:49:21.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43412024-09-16T14:49:21.703ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43422024-09-16T14:49:21.707ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 153.383781ms iteration = 20 status = {"physical_disks_added":0}
43432024-09-16T14:49:21.709ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43442024-09-16T14:49:21.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43452024-09-16T14:49:21.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43462024-09-16T14:49:21.712ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
43472024-09-16T14:49:21.713ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d70d9c11-14c5-40d0-be17-039af1ae521e dns_zone_name = oxide.test found_so_far = 0 version = 2
43482024-09-16T14:49:21.713ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43492024-09-16T14:49:21.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43502024-09-16T14:49:21.744ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43512024-09-16T14:49:21.748ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43522024-09-16T14:49:21.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43532024-09-16T14:49:21.748ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43542024-09-16T14:49:21.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43552024-09-16T14:49:21.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43562024-09-16T14:49:21.751ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d70d9c11-14c5-40d0-be17-039af1ae521e dns_zone_name = oxide.test found_so_far = 1 version = 2
43572024-09-16T14:49:21.751ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
43582024-09-16T14:49:21.751ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-16 14:41:24.562175 UTC dns_group = external generation = 2
43592024-09-16T14:49:21.751ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 197.529822ms iteration = 10 status = {"generation":2}
43602024-09-16T14:49:21.756ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
43612024-09-16T14:49:21.756ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43622024-09-16T14:49:21.756ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7eac9036-7345-492a-99ed-60a665175bf2", "content-length": "26", "date": "Mon, 16 Sep 2024 14:49:20 GMT"} })
43632024-09-16T14:49:21.756ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43642024-09-16T14:49:21.758ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43652024-09-16T14:49:21.770ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 zone_address = fd00:1122:3344:101::2
43662024-09-16T14:49:21.770ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43672024-09-16T14:49:21.770ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6a347053-9af4-4623-bec1-37acd0b0f53e", "content-length": "26", "date": "Mon, 16 Sep 2024 14:49:21 GMT"} })
43682024-09-16T14:49:21.770ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43692024-09-16T14:49:21.772ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
43702024-09-16T14:49:21.776ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43712024-09-16T14:49:21.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43722024-09-16T14:49:21.782ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43732024-09-16T14:49:21.784ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43742024-09-16T14:49:21.784ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43752024-09-16T14:49:21.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43762024-09-16T14:49:21.786ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43772024-09-16T14:49:21.789ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43782024-09-16T14:49:21.789ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43792024-09-16T14:49:21.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43802024-09-16T14:49:21.795ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43812024-09-16T14:49:21.797ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43822024-09-16T14:49:21.797ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43832024-09-16T14:49:21.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43842024-09-16T14:49:21.843ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-16T14:41:19.171997Z, time_modified: 2024-09-16T14:41:19.171997Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2f0f2dc2-cb37-4fec-9d0b-492287602073, db_silo: Silo { identity: SiloIdentity { id: 2f0f2dc2-cb37-4fec-9d0b-492287602073, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-16T14:41:24.495850Z, time_modified: 2024-09-16T14:41:24.495850Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "7a1e72c489a058dd07f837cad69c701f6b45e7cf21c6d4f626d443caf9673a83" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2f0f2dc2-cb37-4fec-9d0b-492287602073, db_silo: Silo { identity: SiloIdentity { id: 2f0f2dc2-cb37-4fec-9d0b-492287602073, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-16T14:41:24.495850Z, time_modified: 2024-09-16T14:41:24.495850Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "7a1e72c489a058dd07f837cad69c701f6b45e7cf21c6d4f626d443caf9673a83" }] }) }
43852024-09-16T14:49:21.843ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 288.795081ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2f0f2dc2-cb37-4fec-9d0b-492287602073","tls_certs":["7a1e72c489a058dd07f837cad69c701f6b45e7cf21c6d4f626d443caf9673a83"]}},"default_endpoint":{"silo_id":"2f0f2dc2-cb37-4fec-9d0b-492287602073","tls_certs":["7a1e72c489a058dd07f837cad69c701f6b45e7cf21c6d4f626d443caf9673a83"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
43862024-09-16T14:49:21.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a31814d3-5e76-4d75-9065-78ea05e16bed roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
43872024-09-16T14:49:21.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a31814d3-5e76-4d75-9065-78ea05e16bed resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
43882024-09-16T14:49:21.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a31814d3-5e76-4d75-9065-78ea05e16bed response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
43892024-09-16T14:49:21.896ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
43902024-09-16T14:49:21.961ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
43912024-09-16T14:49:21.962ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a6338fea-ae33-41f1-ae85-c8df4d41a15f", "content-length": "2", "date": "Mon, 16 Sep 2024 14:49:21 GMT"} })
43922024-09-16T14:49:21.964ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43932024-09-16T14:49:21.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43942024-09-16T14:49:21.965ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43952024-09-16T14:49:21.968ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 414.600297ms iteration = 17 status = null
43962024-09-16T14:49:21.977ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
43972024-09-16T14:49:21.977ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43982024-09-16T14:49:21.978ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ab035b97-c541-4f12-969b-4e4f25f9930b", "content-length": "26", "date": "Mon, 16 Sep 2024 14:49:21 GMT"} })
43992024-09-16T14:49:21.978ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44002024-09-16T14:49:21.979ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44012024-09-16T14:49:21.995ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
44022024-09-16T14:49:22.010ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "15d9a58a-d38a-42fa-b066-167618745159", "content-length": "372", "date": "Mon, 16 Sep 2024 14:49:21 GMT"} })
44032024-09-16T14:49:22.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44042024-09-16T14:49:22.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44052024-09-16T14:49:22.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44062024-09-16T14:49:22.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44072024-09-16T14:49:22.016ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44082024-09-16T14:49:22.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44092024-09-16T14:49:22.044ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
44102024-09-16T14:49:22.045ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f107c8e8-fb0c-45d0-87d0-9f41f0947bd4", "content-length": "691", "date": "Mon, 16 Sep 2024 14:49:21 GMT"} })
44112024-09-16T14:49:22.045ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
44122024-09-16T14:49:22.045ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
44132024-09-16T14:49:22.045ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
44142024-09-16T14:49:22.046ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 492.274767ms iteration = 18 status = {}
44152024-09-16T14:49:22.047ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44162024-09-16T14:49:22.047ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "de143413-6535-4195-b1c4-477d5df18ac0", "date": "Mon, 16 Sep 2024 14:49:21 GMT"} })
44172024-09-16T14:49:22.049ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 494.670362ms iteration = 19 status = {}
44182024-09-16T14:49:22.130ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 576.275036ms iteration = 17 status = {}
44192024-09-16T14:49:22.164ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
44202024-09-16T14:49:22.164ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "17103ede-506d-407b-b9db-be17b1aa10b6", "date": "Mon, 16 Sep 2024 14:49:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44212024-09-16T14:49:22.164ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44222024-09-16T14:49:22.166ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "26c6b574-4758-40c4-b5fe-469540338b99", "date": "Mon, 16 Sep 2024 14:49:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44232024-09-16T14:49:22.166ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44242024-09-16T14:49:22.168ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44252024-09-16T14:49:22.168ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 614.28168ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
44262024-09-16T14:49:22.177ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
44272024-09-16T14:49:22.202ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44282024-09-16T14:49:22.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44292024-09-16T14:49:22.204ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 94d6770e-63ed-455d-aa9f-8ad47c66c84e, rack_id: 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bc13c6ca-2923-40a0-a45c-bfa5d94842d2) } rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0
44302024-09-16T14:49:22.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44312024-09-16T14:49:22.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44322024-09-16T14:49:22.214ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
44332024-09-16T14:49:22.214ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "68d26cec-2655-446d-b3b8-c16c66316be0", "content-length": "121", "date": "Mon, 16 Sep 2024 14:49:21 GMT"} })
44342024-09-16T14:49:22.214ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
44352024-09-16T14:49:22.214ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bc13c6ca-2923-40a0-a45c-bfa5d94842d2
44362024-09-16T14:49:22.215ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44372024-09-16T14:49:22.215ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44382024-09-16T14:49:22.215ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {}
44392024-09-16T14:49:22.215ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {}
44402024-09-16T14:49:22.215ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
44412024-09-16T14:49:22.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44422024-09-16T14:49:22.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44432024-09-16T14:49:22.217ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44442024-09-16T14:49:22.217ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "86792583-5292-4882-9bc6-5d2600e8674a", "content-length": "2", "date": "Mon, 16 Sep 2024 14:49:21 GMT"} })
44452024-09-16T14:49:22.217ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44462024-09-16T14:49:22.217ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fa64363c-9400-4cd0-b65d-8f5a97a75d76", "content-length": "52", "date": "Mon, 16 Sep 2024 14:49:21 GMT"} })
44472024-09-16T14:49:22.217ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0
44482024-09-16T14:49:22.217ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44492024-09-16T14:49:22.220ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
44502024-09-16T14:49:22.221ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "cb1e08ac-6af1-4ccf-8eba-b055b506b4cd", "date": "Mon, 16 Sep 2024 14:49:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
44512024-09-16T14:49:22.222ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
44522024-09-16T14:49:22.223ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2c4b8ff2-f4da-44de-b6e0-2ed479f5fe02", "date": "Mon, 16 Sep 2024 14:49:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
44532024-09-16T14:49:22.223ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
44542024-09-16T14:49:22.225ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3940067b-46b7-44a7-b107-b1eca01e88ba", "date": "Mon, 16 Sep 2024 14:49:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
44552024-09-16T14:49:22.225ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
44562024-09-16T14:49:22.227ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
44572024-09-16T14:49:22.227ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 673.337895ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
44582024-09-16T14:49:22.329ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d8f07184-128a-436a-b757-a3830aead084", "date": "Mon, 16 Sep 2024 14:49:21 GMT"} })
44592024-09-16T14:49:22.329ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch = Switch0
44602024-09-16T14:49:22.329ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
44612024-09-16T14:49:22.427ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "df42bea0-010f-4b29-9ecc-dee3cce55b14", "content-length": "667", "date": "Mon, 16 Sep 2024 14:49:21 GMT"} })
44622024-09-16T14:49:22.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44632024-09-16T14:49:22.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44642024-09-16T14:49:22.431ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44652024-09-16T14:49:22.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44662024-09-16T14:49:22.434ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44672024-09-16T14:49:22.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44682024-09-16T14:49:22.436ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44692024-09-16T14:49:22.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44702024-09-16T14:49:22.444ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 890.242416ms iteration = 17 status = {}
44712024-09-16T14:49:22.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 2ccf2d89-de4b-4d2a-9fc8-b29381e5501a roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44722024-09-16T14:49:22.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 2ccf2d89-de4b-4d2a-9fc8-b29381e5501a resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44732024-09-16T14:49:22.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2515 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 2ccf2d89-de4b-4d2a-9fc8-b29381e5501a response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44742024-09-16T14:49:23.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4704592a-9ba4-4780-86b9-b814ce3e0c7b roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44752024-09-16T14:49:23.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4704592a-9ba4-4780-86b9-b814ce3e0c7b resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44762024-09-16T14:49:23.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4704592a-9ba4-4780-86b9-b814ce3e0c7b response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44772024-09-16T14:49:24.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4f0c1316-b2a4-4faf-af79-b7f263217867 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44782024-09-16T14:49:24.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4f0c1316-b2a4-4faf-af79-b7f263217867 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44792024-09-16T14:49:24.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1699 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 4f0c1316-b2a4-4faf-af79-b7f263217867 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44802024-09-16T14:49:25.955ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = 35a0a21f-bd31-4a65-8f21-c64f711a42bd response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
44812024-09-16T14:49:25.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8253e911-0282-4fce-b7db-b02eab41878d roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44822024-09-16T14:49:25.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8253e911-0282-4fce-b7db-b02eab41878d resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44832024-09-16T14:49:25.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8253e911-0282-4fce-b7db-b02eab41878d response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44842024-09-16T14:49:26.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 42404052-007e-42e0-abba-b94441f64a41 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44852024-09-16T14:49:26.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 42404052-007e-42e0-abba-b94441f64a41 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44862024-09-16T14:49:26.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 42404052-007e-42e0-abba-b94441f64a41 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44872024-09-16T14:49:28.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 09f80c7d-74ba-4b24-992f-7e83cde801d1 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44882024-09-16T14:49:28.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 09f80c7d-74ba-4b24-992f-7e83cde801d1 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44892024-09-16T14:49:28.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 09f80c7d-74ba-4b24-992f-7e83cde801d1 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44902024-09-16T14:49:29.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = cdde7b35-1815-4337-90a5-6cf01efe4d63 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44912024-09-16T14:49:29.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = cdde7b35-1815-4337-90a5-6cf01efe4d63 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44922024-09-16T14:49:29.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = cdde7b35-1815-4337-90a5-6cf01efe4d63 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44932024-09-16T14:49:30.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 045bde3e-312a-42ae-9d45-6d8836b93b4c roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44942024-09-16T14:49:30.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 045bde3e-312a-42ae-9d45-6d8836b93b4c resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44952024-09-16T14:49:30.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 045bde3e-312a-42ae-9d45-6d8836b93b4c response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44962024-09-16T14:49:31.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8f13f98b-9ebe-41e1-8cb9-687e5f2cdb8e roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44972024-09-16T14:49:31.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8f13f98b-9ebe-41e1-8cb9-687e5f2cdb8e resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44982024-09-16T14:49:31.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 8f13f98b-9ebe-41e1-8cb9-687e5f2cdb8e response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
44992024-09-16T14:49:31.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
45002024-09-16T14:49:31.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
45012024-09-16T14:49:31.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45022024-09-16T14:49:31.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45032024-09-16T14:49:31.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45042024-09-16T14:49:31.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45052024-09-16T14:49:31.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45062024-09-16T14:49:31.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45072024-09-16T14:49:31.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45082024-09-16T14:49:31.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45092024-09-16T14:49:31.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45102024-09-16T14:49:31.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45112024-09-16T14:49:31.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45122024-09-16T14:49:31.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
45132024-09-16T14:49:31.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45142024-09-16T14:49:31.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45152024-09-16T14:49:31.575ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
45162024-09-16T14:49:31.575ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.161704ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
45172024-09-16T14:49:31.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45182024-09-16T14:49:31.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45192024-09-16T14:49:31.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.871434ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45202024-09-16T14:49:32.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = cdc9fcca-3426-4327-8f12-8d1161ec9d40 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45212024-09-16T14:49:32.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = cdc9fcca-3426-4327-8f12-8d1161ec9d40 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45222024-09-16T14:49:32.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = cdc9fcca-3426-4327-8f12-8d1161ec9d40 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45232024-09-16T14:49:33.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f7b1416a-31d8-4b63-9956-a6d92daa67e3 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45242024-09-16T14:49:33.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f7b1416a-31d8-4b63-9956-a6d92daa67e3 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45252024-09-16T14:49:33.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2474 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f7b1416a-31d8-4b63-9956-a6d92daa67e3 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45262024-09-16T14:49:34.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 0152e542-8c42-4903-87d8-3870f40108c6 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45272024-09-16T14:49:34.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 0152e542-8c42-4903-87d8-3870f40108c6 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45282024-09-16T14:49:34.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 0152e542-8c42-4903-87d8-3870f40108c6 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45292024-09-16T14:49:35.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 200f7a2d-add8-4f3b-9f7c-451954e2f715 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45302024-09-16T14:49:35.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 200f7a2d-add8-4f3b-9f7c-451954e2f715 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45312024-09-16T14:49:35.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 200f7a2d-add8-4f3b-9f7c-451954e2f715 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45322024-09-16T14:49:35.955ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1486 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = c5576c47-6d1d-4b16-a198-1c81af9eeb1a response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
45332024-09-16T14:49:36.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c6269118-69fa-4b0f-a821-375ffaa1f0ab roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45342024-09-16T14:49:36.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c6269118-69fa-4b0f-a821-375ffaa1f0ab resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45352024-09-16T14:49:36.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2609 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c6269118-69fa-4b0f-a821-375ffaa1f0ab response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45362024-09-16T14:49:37.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 169d5ddb-113e-4c20-8adf-c6a57bee3c76 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45372024-09-16T14:49:37.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 169d5ddb-113e-4c20-8adf-c6a57bee3c76 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45382024-09-16T14:49:37.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 169d5ddb-113e-4c20-8adf-c6a57bee3c76 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45392024-09-16T14:49:38.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3f0cc4fc-07ce-4658-bb2b-65cdcba2be71 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45402024-09-16T14:49:38.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3f0cc4fc-07ce-4658-bb2b-65cdcba2be71 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45412024-09-16T14:49:38.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 3f0cc4fc-07ce-4658-bb2b-65cdcba2be71 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45422024-09-16T14:49:39.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c2e45fe6-45f2-4107-9fe5-2ac20b56f905 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45432024-09-16T14:49:39.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c2e45fe6-45f2-4107-9fe5-2ac20b56f905 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45442024-09-16T14:49:39.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c2e45fe6-45f2-4107-9fe5-2ac20b56f905 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45452024-09-16T14:49:40.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 16d6c827-c0ba-4e97-9545-c25634342316 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45462024-09-16T14:49:40.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 16d6c827-c0ba-4e97-9545-c25634342316 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45472024-09-16T14:49:40.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 16d6c827-c0ba-4e97-9545-c25634342316 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45482024-09-16T14:49:41.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 015c351e-c5c8-4327-b112-3496220d0071 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45492024-09-16T14:49:41.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 015c351e-c5c8-4327-b112-3496220d0071 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45502024-09-16T14:49:41.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 015c351e-c5c8-4327-b112-3496220d0071 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45512024-09-16T14:49:41.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
45522024-09-16T14:49:41.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
45532024-09-16T14:49:41.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45542024-09-16T14:49:41.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45552024-09-16T14:49:41.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45562024-09-16T14:49:41.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45572024-09-16T14:49:41.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45582024-09-16T14:49:41.556ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45592024-09-16T14:49:41.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45602024-09-16T14:49:41.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45612024-09-16T14:49:41.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45622024-09-16T14:49:41.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45632024-09-16T14:49:41.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45642024-09-16T14:49:41.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45652024-09-16T14:49:41.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45662024-09-16T14:49:41.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
45672024-09-16T14:49:41.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45682024-09-16T14:49:41.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45692024-09-16T14:49:41.570ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
45702024-09-16T14:49:41.570ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.481465ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
45712024-09-16T14:49:41.583ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.600754ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45722024-09-16T14:49:42.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c6a2e31a-2cda-4e3a-a2de-25afccb929ab roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45732024-09-16T14:49:42.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c6a2e31a-2cda-4e3a-a2de-25afccb929ab resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45742024-09-16T14:49:42.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c6a2e31a-2cda-4e3a-a2de-25afccb929ab response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45752024-09-16T14:49:43.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 9c96f150-4507-46d5-91dd-f759727d18bc roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45762024-09-16T14:49:43.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 9c96f150-4507-46d5-91dd-f759727d18bc resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45772024-09-16T14:49:43.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2525 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 9c96f150-4507-46d5-91dd-f759727d18bc response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45782024-09-16T14:49:44.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 483ea1e1-cec2-478d-ab64-a161b8693b82 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45792024-09-16T14:49:44.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 483ea1e1-cec2-478d-ab64-a161b8693b82 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45802024-09-16T14:49:44.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2743 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 483ea1e1-cec2-478d-ab64-a161b8693b82 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45812024-09-16T14:49:45.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 01c227dc-abd2-4688-a4f3-2a9297033c6c roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45822024-09-16T14:49:45.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 01c227dc-abd2-4688-a4f3-2a9297033c6c resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45832024-09-16T14:49:45.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 01c227dc-abd2-4688-a4f3-2a9297033c6c response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45842024-09-16T14:49:45.954ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1266 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = 6a91066e-f014-4546-802a-711beaa34523 response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
45852024-09-16T14:49:46.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 08f72bcc-e12d-4926-b942-05ccf2933403 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45862024-09-16T14:49:46.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 08f72bcc-e12d-4926-b942-05ccf2933403 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45872024-09-16T14:49:46.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2721 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 08f72bcc-e12d-4926-b942-05ccf2933403 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45882024-09-16T14:49:47.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a8aa5c91-2446-446e-b4a3-e47454138365 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45892024-09-16T14:49:47.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a8aa5c91-2446-446e-b4a3-e47454138365 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45902024-09-16T14:49:47.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = a8aa5c91-2446-446e-b4a3-e47454138365 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45912024-09-16T14:49:48.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 90b396f7-a5fb-454d-b21f-82eaac3cd347 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45922024-09-16T14:49:48.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 90b396f7-a5fb-454d-b21f-82eaac3cd347 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45932024-09-16T14:49:48.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2756 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 90b396f7-a5fb-454d-b21f-82eaac3cd347 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45942024-09-16T14:49:49.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 697391f1-68c3-426c-b9a7-c0d3c7ea3d1e roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45952024-09-16T14:49:49.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 697391f1-68c3-426c-b9a7-c0d3c7ea3d1e resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45962024-09-16T14:49:49.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 697391f1-68c3-426c-b9a7-c0d3c7ea3d1e response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45972024-09-16T14:49:50.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 94656143-f65f-4c16-a2c9-6c1307ffed56 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45982024-09-16T14:49:50.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 94656143-f65f-4c16-a2c9-6c1307ffed56 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
45992024-09-16T14:49:50.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1794 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 94656143-f65f-4c16-a2c9-6c1307ffed56 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
46002024-09-16T14:49:51.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 0035ae5a-ff05-433c-a77a-cbdd07a6b16a roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
46012024-09-16T14:49:51.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 0035ae5a-ff05-433c-a77a-cbdd07a6b16a resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
46022024-09-16T14:49:51.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 0035ae5a-ff05-433c-a77a-cbdd07a6b16a response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
46032024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
46042024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46052024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
46062024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
46072024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
46082024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
46092024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
46102024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46112024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46122024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
46132024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
46142024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46152024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46162024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46172024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
46182024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
46192024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
46202024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
46212024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46222024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46232024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
46242024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
46252024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
46262024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46272024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
46282024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
46292024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46302024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
46312024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46322024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46332024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
46342024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46352024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
46362024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46372024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
46382024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46392024-09-16T14:49:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46402024-09-16T14:49:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46412024-09-16T14:49:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46422024-09-16T14:49:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46432024-09-16T14:49:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46442024-09-16T14:49:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46452024-09-16T14:49:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46462024-09-16T14:49:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46472024-09-16T14:49:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46482024-09-16T14:49:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46492024-09-16T14:49:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
46502024-09-16T14:49:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46512024-09-16T14:49:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46522024-09-16T14:49:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46532024-09-16T14:49:51.556ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 1.960597ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
46542024-09-16T14:49:51.556ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.175571ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
46552024-09-16T14:49:51.558ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24280, tv_nsec: 517351850 } })
46562024-09-16T14:49:51.561ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24280, tv_nsec: 520029361 } })
46572024-09-16T14:49:51.561ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
46582024-09-16T14:49:51.563ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
46592024-09-16T14:49:51.565ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46602024-09-16T14:49:51.565ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46612024-09-16T14:49:51.565ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46622024-09-16T14:49:51.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46632024-09-16T14:49:51.568ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46642024-09-16T14:49:51.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46652024-09-16T14:49:51.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
46662024-09-16T14:49:51.569ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46672024-09-16T14:49:51.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46682024-09-16T14:49:51.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
46692024-09-16T14:49:51.569ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46702024-09-16T14:49:51.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46712024-09-16T14:49:51.572ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46722024-09-16T14:49:51.572ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46732024-09-16T14:49:51.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46742024-09-16T14:49:51.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46752024-09-16T14:49:51.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f26461d2-04fe-40aa-80c2-1eb0bc461628.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 24280, tv_nsec: 532950857 } })
46762024-09-16T14:49:51.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
46772024-09-16T14:49:51.593ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 38.543714ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
46782024-09-16T14:49:51.595ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46792024-09-16T14:49:51.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46802024-09-16T14:49:51.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46812024-09-16T14:49:51.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46822024-09-16T14:49:51.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46832024-09-16T14:49:51.599ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46842024-09-16T14:49:51.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46852024-09-16T14:49:51.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46862024-09-16T14:49:51.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46872024-09-16T14:49:51.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46882024-09-16T14:49:51.600ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46892024-09-16T14:49:51.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46902024-09-16T14:49:51.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46912024-09-16T14:49:51.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46922024-09-16T14:49:51.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46932024-09-16T14:49:51.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46942024-09-16T14:49:51.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46952024-09-16T14:49:51.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46962024-09-16T14:49:51.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46972024-09-16T14:49:51.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46982024-09-16T14:49:51.603ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46992024-09-16T14:49:51.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47002024-09-16T14:49:51.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47012024-09-16T14:49:51.604ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
47022024-09-16T14:49:51.604ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
47032024-09-16T14:49:51.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47042024-09-16T14:49:51.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47052024-09-16T14:49:51.604ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47062024-09-16T14:49:51.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47072024-09-16T14:49:51.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f26461d2-04fe-40aa-80c2-1eb0bc461628, lookup_type: ById(f26461d2-04fe-40aa-80c2-1eb0bc461628) } result = Ok(())
47082024-09-16T14:49:51.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47092024-09-16T14:49:51.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47102024-09-16T14:49:51.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47112024-09-16T14:49:51.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47122024-09-16T14:49:51.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
47132024-09-16T14:49:51.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47142024-09-16T14:49:51.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47152024-09-16T14:49:51.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47162024-09-16T14:49:51.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47172024-09-16T14:49:51.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47182024-09-16T14:49:51.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47192024-09-16T14:49:51.608ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 53.706523ms iteration = 18 status = 0
47202024-09-16T14:49:51.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47212024-09-16T14:49:51.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47222024-09-16T14:49:51.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47232024-09-16T14:49:51.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 85.01765ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
47242024-09-16T14:49:51.649ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
47252024-09-16T14:49:51.649ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47262024-09-16T14:49:51.650ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "45dc5c37-2cba-4ae5-bdc3-227d835887a4", "content-length": "26", "date": "Mon, 16 Sep 2024 14:49:50 GMT"} })
47272024-09-16T14:49:51.650ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47282024-09-16T14:49:51.651ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 96.754213ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47292024-09-16T14:49:51.651ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
47302024-09-16T14:49:51.651ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47312024-09-16T14:49:51.652ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "afa2d535-4900-414d-a448-20be7fbbcfde", "content-length": "26", "date": "Mon, 16 Sep 2024 14:49:50 GMT"} })
47322024-09-16T14:49:51.652ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47332024-09-16T14:49:51.656ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47342024-09-16T14:49:51.658ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47352024-09-16T14:49:51.658ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
47362024-09-16T14:49:51.658ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47372024-09-16T14:49:51.658ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47382024-09-16T14:49:51.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47392024-09-16T14:49:51.659ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47402024-09-16T14:49:51.660ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 106.284225ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
47412024-09-16T14:49:51.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
47422024-09-16T14:49:51.662ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47432024-09-16T14:49:51.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47442024-09-16T14:49:51.666ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 111.649826ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
47452024-09-16T14:49:51.671ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:539 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47462024-09-16T14:49:51.671ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 117.169652ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47472024-09-16T14:49:51.673ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
47482024-09-16T14:49:51.673ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 118.725472ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
47492024-09-16T14:49:51.684ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 zone_address = fd00:1122:3344:101::2
47502024-09-16T14:49:51.684ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47512024-09-16T14:49:51.685ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9c7ee3d0-b81f-4905-ba54-870a61633bab", "content-length": "26", "date": "Mon, 16 Sep 2024 14:49:50 GMT"} })
47522024-09-16T14:49:51.685ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47532024-09-16T14:49:51.687ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
47542024-09-16T14:49:51.692ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:58
47552024-09-16T14:49:51.692ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:226 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47562024-09-16T14:49:51.692ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 138.228583ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
47572024-09-16T14:49:51.702ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47582024-09-16T14:49:51.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47592024-09-16T14:49:51.726ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 172.271861ms iteration = 21 status = {"physical_disks_added":0}
47602024-09-16T14:49:51.765ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 211.207014ms iteration = 18 status = {}
47612024-09-16T14:49:51.800ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47622024-09-16T14:49:51.808ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47632024-09-16T14:49:51.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47642024-09-16T14:49:51.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47652024-09-16T14:49:51.813ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47662024-09-16T14:49:51.813ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47672024-09-16T14:49:51.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47682024-09-16T14:49:51.815ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47692024-09-16T14:49:51.817ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47702024-09-16T14:49:51.817ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47712024-09-16T14:49:51.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47722024-09-16T14:49:51.823ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
47732024-09-16T14:49:51.823ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "232b4489-8415-43a4-b370-f63b19887d79", "content-length": "2", "date": "Mon, 16 Sep 2024 14:49:51 GMT"} })
47742024-09-16T14:49:51.828ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47752024-09-16T14:49:51.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47762024-09-16T14:49:51.835ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 280.622755ms iteration = 18 status = null
47772024-09-16T14:49:51.884ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
47782024-09-16T14:49:51.908ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0c13b1a3-75ff-485b-b474-fd8001acef75", "content-length": "691", "date": "Mon, 16 Sep 2024 14:49:51 GMT"} })
47792024-09-16T14:49:51.908ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
47802024-09-16T14:49:51.908ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
47812024-09-16T14:49:51.908ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
47822024-09-16T14:49:51.908ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "85afba0c-d1bd-4913-aa09-f13212e3c0c3", "content-length": "372", "date": "Mon, 16 Sep 2024 14:49:51 GMT"} })
47832024-09-16T14:49:51.908ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47842024-09-16T14:49:51.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47852024-09-16T14:49:51.909ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 355.188855ms iteration = 19 status = {}
47862024-09-16T14:49:51.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47872024-09-16T14:49:51.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47882024-09-16T14:49:51.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47892024-09-16T14:49:51.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47902024-09-16T14:49:51.916ZDEBGnexus (BackgroundTasks): client request SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47912024-09-16T14:49:51.917ZDEBGnexus (BackgroundTasks): client response SledAgent = f26461d2-04fe-40aa-80c2-1eb0bc461628 background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9c5eb416-d116-4b45-a37d-e7b28a83bb55", "date": "Mon, 16 Sep 2024 14:49:51 GMT"} })
47922024-09-16T14:49:51.919ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 364.800379ms iteration = 20 status = {}
47932024-09-16T14:49:51.930ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47942024-09-16T14:49:51.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47952024-09-16T14:49:51.933ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 94d6770e-63ed-455d-aa9f-8ad47c66c84e, rack_id: 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bc13c6ca-2923-40a0-a45c-bfa5d94842d2) } rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0
47962024-09-16T14:49:51.933ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47972024-09-16T14:49:51.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47982024-09-16T14:49:51.941ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
47992024-09-16T14:49:51.942ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3f0c005e-31cf-4109-9596-9fd711e7c783", "content-length": "121", "date": "Mon, 16 Sep 2024 14:49:51 GMT"} })
48002024-09-16T14:49:51.942ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
48012024-09-16T14:49:51.942ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bc13c6ca-2923-40a0-a45c-bfa5d94842d2
48022024-09-16T14:49:51.942ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48032024-09-16T14:49:51.942ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48042024-09-16T14:49:51.942ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {}
48052024-09-16T14:49:51.942ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 routes = {}
48062024-09-16T14:49:51.942ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3
48072024-09-16T14:49:51.942ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48082024-09-16T14:49:51.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48092024-09-16T14:49:51.944ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
48102024-09-16T14:49:51.944ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e581e30c-26de-41fb-a731-4657358e220f", "content-length": "2", "date": "Mon, 16 Sep 2024 14:49:51 GMT"} })
48112024-09-16T14:49:51.944ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
48122024-09-16T14:49:51.944ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "70651d47-ac21-4f56-82c7-577fc310a9fc", "content-length": "52", "date": "Mon, 16 Sep 2024 14:49:51 GMT"} })
48132024-09-16T14:49:51.944ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch_location = Switch0
48142024-09-16T14:49:51.944ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48152024-09-16T14:49:52.041ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "fde4a91e-c622-411d-8899-4aed6cbb3b3f", "date": "Mon, 16 Sep 2024 14:49:51 GMT"} })
48162024-09-16T14:49:52.041ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 switch = Switch0
48172024-09-16T14:49:52.041ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48182024-09-16T14:49:52.042ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 13a675b5-d6ac-4ec4-8ae1-cfa3c73961a3 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a3c36a4b-aa2e-4b8e-bcef-5c100488dd77", "content-length": "667", "date": "Mon, 16 Sep 2024 14:49:51 GMT"} })
48192024-09-16T14:49:52.042ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48202024-09-16T14:49:52.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48212024-09-16T14:49:52.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48222024-09-16T14:49:52.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48232024-09-16T14:49:52.048ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48242024-09-16T14:49:52.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48252024-09-16T14:49:52.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48262024-09-16T14:49:52.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48272024-09-16T14:49:52.058ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 503.635173ms iteration = 18 status = {}
48282024-09-16T14:49:52.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d2711f38-134e-44c5-b5a6-f3654bdd7c9d roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48292024-09-16T14:49:52.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d2711f38-134e-44c5-b5a6-f3654bdd7c9d resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48302024-09-16T14:49:52.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d2711f38-134e-44c5-b5a6-f3654bdd7c9d response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48312024-09-16T14:49:53.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = ce2b77aa-1b1f-42cc-a57d-d0f59b6d9be9 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48322024-09-16T14:49:53.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = ce2b77aa-1b1f-42cc-a57d-d0f59b6d9be9 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48332024-09-16T14:49:53.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = ce2b77aa-1b1f-42cc-a57d-d0f59b6d9be9 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48342024-09-16T14:49:54.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5c305ee1-ec62-43f0-9da6-8973224e8c15 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48352024-09-16T14:49:54.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5c305ee1-ec62-43f0-9da6-8973224e8c15 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48362024-09-16T14:49:54.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 5c305ee1-ec62-43f0-9da6-8973224e8c15 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48372024-09-16T14:49:55.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d62763d4-1fbd-44c2-8eb3-ab1dcfb6b172 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48382024-09-16T14:49:55.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d62763d4-1fbd-44c2-8eb3-ab1dcfb6b172 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48392024-09-16T14:49:55.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d62763d4-1fbd-44c2-8eb3-ab1dcfb6b172 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48402024-09-16T14:49:55.955ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1673 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = 1aa9a6e0-355e-4a43-be8c-5bd29ad65aad response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
48412024-09-16T14:49:56.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 882f4396-8f25-4832-9bd0-aa8cb960e74a roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48422024-09-16T14:49:56.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 882f4396-8f25-4832-9bd0-aa8cb960e74a resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48432024-09-16T14:49:56.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 882f4396-8f25-4832-9bd0-aa8cb960e74a response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48442024-09-16T14:49:57.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 323e26be-f132-4a12-9292-90c073e6372f roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48452024-09-16T14:49:57.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 323e26be-f132-4a12-9292-90c073e6372f resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48462024-09-16T14:49:57.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 323e26be-f132-4a12-9292-90c073e6372f response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48472024-09-16T14:49:58.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e5f1d340-eb93-4d9f-86b2-2867de8e6463 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48482024-09-16T14:49:58.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e5f1d340-eb93-4d9f-86b2-2867de8e6463 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48492024-09-16T14:49:58.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e5f1d340-eb93-4d9f-86b2-2867de8e6463 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48502024-09-16T14:49:59.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e9c9875a-5f21-4ed8-868f-a04fa4779af5 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48512024-09-16T14:49:59.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e9c9875a-5f21-4ed8-868f-a04fa4779af5 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48522024-09-16T14:49:59.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2552 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e9c9875a-5f21-4ed8-868f-a04fa4779af5 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48532024-09-16T14:50:00.662ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:60226
48542024-09-16T14:50:00.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60226 req_id = affeefee-8375-46a1-b785-5f5e7a7102a6 roles = RoleSet { roles: {} } uri = /metrics/producers
48552024-09-16T14:50:00.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60226 req_id = affeefee-8375-46a1-b785-5f5e7a7102a6 resource = Database result = Ok(()) uri = /metrics/producers
48562024-09-16T14:50:00.696ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d9cae32d-8e84-4f97-9d87-f815a97563b7
48572024-09-16T14:50:00.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60226 req_id = affeefee-8375-46a1-b785-5f5e7a7102a6 roles = RoleSet { roles: {} } uri = /metrics/producers
48582024-09-16T14:50:00.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60226 req_id = affeefee-8375-46a1-b785-5f5e7a7102a6 resource = Database result = Ok(()) uri = /metrics/producers
48592024-09-16T14:50:00.734ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 uri = http://[fd00:1122:3344:101::d]:12223/producers
48602024-09-16T14:50:00.734ZDEBGnexus: client response oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3a64d3f8-d57c-49b8-987b-d6bddcc7724f", "date": "Mon, 16 Sep 2024 14:50:00 GMT"} })
48612024-09-16T14:50:00.734ZINFOnexus: assigned collector to new producer collector_id = d9cae32d-8e84-4f97-9d87-f815a97563b7 file = nexus/src/app/oximeter.rs:125 producer_id = 881d88a2-03c8-4c19-b7d6-7d5febb79625
48622024-09-16T14:50:00.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 74035 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60226 req_id = affeefee-8375-46a1-b785-5f5e7a7102a6 response_code = 201 uri = /metrics/producers
48632024-09-16T14:50:00.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e677d2a5-3b6b-4883-a230-5d97bb422de0 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48642024-09-16T14:50:00.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e677d2a5-3b6b-4883-a230-5d97bb422de0 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48652024-09-16T14:50:00.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = e677d2a5-3b6b-4883-a230-5d97bb422de0 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48662024-09-16T14:50:01.554ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
48672024-09-16T14:50:01.554ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
48682024-09-16T14:50:01.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48692024-09-16T14:50:01.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48702024-09-16T14:50:01.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48712024-09-16T14:50:01.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48722024-09-16T14:50:01.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48732024-09-16T14:50:01.556ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48742024-09-16T14:50:01.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48752024-09-16T14:50:01.558ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.490115ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48762024-09-16T14:50:01.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48772024-09-16T14:50:01.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48782024-09-16T14:50:01.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48792024-09-16T14:50:01.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48802024-09-16T14:50:01.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48812024-09-16T14:50:01.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48822024-09-16T14:50:01.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0ccec338-5ba9-47fe-a3a4-0f6d498514e2, lookup_type: ById(0ccec338-5ba9-47fe-a3a4-0f6d498514e2) } result = Ok(())
48832024-09-16T14:50:01.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48842024-09-16T14:50:01.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48852024-09-16T14:50:01.576ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 original_time_created = 2024-09-16 14:40:59.087263 UTC target_id = 0ccec338-5ba9-47fe-a3a4-0f6d498514e2 time_created = 2024-09-16 14:40:59.087263 UTC
48862024-09-16T14:50:01.576ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.999789ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0ccec338-5ba9-47fe-a3a4-0f6d498514e2","time_created":"2024-09-16T14:40:59.087263Z"}
48872024-09-16T14:50:01.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7ce8b02b-7bf2-4945-a544-6874df763965 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48882024-09-16T14:50:01.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7ce8b02b-7bf2-4945-a544-6874df763965 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48892024-09-16T14:50:01.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 7ce8b02b-7bf2-4945-a544-6874df763965 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48902024-09-16T14:50:02.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c0914028-c0ce-4c66-b847-46aedb99c6a2 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48912024-09-16T14:50:02.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c0914028-c0ce-4c66-b847-46aedb99c6a2 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48922024-09-16T14:50:02.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = c0914028-c0ce-4c66-b847-46aedb99c6a2 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48932024-09-16T14:50:03.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d4264df4-cf81-49ae-aaba-1924837e899b roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48942024-09-16T14:50:03.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d4264df4-cf81-49ae-aaba-1924837e899b resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48952024-09-16T14:50:03.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d4264df4-cf81-49ae-aaba-1924837e899b response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48962024-09-16T14:50:04.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 20d5b1cd-f0d2-4213-9213-6a5a07e5e258 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48972024-09-16T14:50:04.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 20d5b1cd-f0d2-4213-9213-6a5a07e5e258 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48982024-09-16T14:50:04.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = 20d5b1cd-f0d2-4213-9213-6a5a07e5e258 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
48992024-09-16T14:50:04.887ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:59328
49002024-09-16T14:50:04.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59328 req_id = 2d2ddfd6-74ed-46a3-9ba3-d2d570ac9113 roles = RoleSet { roles: {} } uri = /metrics/producers
49012024-09-16T14:50:04.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59328 req_id = 2d2ddfd6-74ed-46a3-9ba3-d2d570ac9113 resource = Database result = Ok(()) uri = /metrics/producers
49022024-09-16T14:50:04.922ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d9cae32d-8e84-4f97-9d87-f815a97563b7
49032024-09-16T14:50:04.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59328 req_id = 2d2ddfd6-74ed-46a3-9ba3-d2d570ac9113 roles = RoleSet { roles: {} } uri = /metrics/producers
49042024-09-16T14:50:04.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59328 req_id = 2d2ddfd6-74ed-46a3-9ba3-d2d570ac9113 resource = Database result = Ok(()) uri = /metrics/producers
49052024-09-16T14:50:04.956ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 uri = http://[fd00:1122:3344:101::d]:12223/producers
49062024-09-16T14:50:04.956ZDEBGnexus: client response oximeter-collector = d9cae32d-8e84-4f97-9d87-f815a97563b7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b6d82c76-7fa6-47c6-ad0c-1ee2a2c38210", "date": "Mon, 16 Sep 2024 14:50:04 GMT"} })
49072024-09-16T14:50:04.956ZINFOnexus: assigned collector to new producer collector_id = d9cae32d-8e84-4f97-9d87-f815a97563b7 file = nexus/src/app/oximeter.rs:125 producer_id = ab94c385-d2ae-4032-9ac3-7db416af9813
49082024-09-16T14:50:04.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 69644 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59328 req_id = 2d2ddfd6-74ed-46a3-9ba3-d2d570ac9113 response_code = 201 uri = /metrics/producers
49092024-09-16T14:50:05.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d2b20da1-7b42-4149-8c6d-a383c67a368c roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
49102024-09-16T14:50:05.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d2b20da1-7b42-4149-8c6d-a383c67a368c resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
49112024-09-16T14:50:05.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = d2b20da1-7b42-4149-8c6d-a383c67a368c response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
49122024-09-16T14:50:05.955ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1272 local_addr = [fd00:1122:3344:101::c]:65292 method = GET remote_addr = [fd00:1122:3344:101::d]:49577 req_id = de09c257-8913-4c79-b4f7-929bb071d654 response_code = 200 uri = /1ee13a98-c783-4c45-9593-448411671260
49132024-09-16T14:50:06.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f76fe3dd-59ff-400f-b949-ed3818a6e689 roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
49142024-09-16T14:50:06.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f76fe3dd-59ff-400f-b949-ed3818a6e689 resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
49152024-09-16T14:50:06.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3788 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = f76fe3dd-59ff-400f-b949-ed3818a6e689 response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
49162024-09-16T14:50:07.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = da7970a9-cfbd-4985-ae9b-74d74ca2094d roles = RoleSet { roles: {} } uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
49172024-09-16T14:50:07.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = da7970a9-cfbd-4985-ae9b-74d74ca2094d resource = Database result = Ok(()) uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628
49182024-09-16T14:50:07.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45812 req_id = da7970a9-cfbd-4985-ae9b-74d74ca2094d response_code = 200 uri = /probes/f26461d2-04fe-40aa-80c2-1eb0bc461628