Max level shown:
12024-11-09T01:30:02.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 287228b8-ca2b-495d-bb70-d002516fd9a6 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
22024-11-09T01:30:02.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 287228b8-ca2b-495d-bb70-d002516fd9a6 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32024-11-09T01:30:02.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 287228b8-ca2b-495d-bb70-d002516fd9a6 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
42024-11-09T01:30:03.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 41c8a45c-9b4c-4c21-9f49-ce18c79b105e roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
52024-11-09T01:30:03.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 41c8a45c-9b4c-4c21-9f49-ce18c79b105e resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
62024-11-09T01:30:03.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2468 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 41c8a45c-9b4c-4c21-9f49-ce18c79b105e response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
72024-11-09T01:30:04.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c80ec899-b8aa-4745-bc73-a7aeae2186d7 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
82024-11-09T01:30:04.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c80ec899-b8aa-4745-bc73-a7aeae2186d7 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
92024-11-09T01:30:04.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1933 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c80ec899-b8aa-4745-bc73-a7aeae2186d7 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
102024-11-09T01:30:04.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = c2434a5a-58a5-4599-adea-628ae99af559 roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
112024-11-09T01:30:04.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = c2434a5a-58a5-4599-adea-628ae99af559 resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
122024-11-09T01:30:04.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2833 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = c2434a5a-58a5-4599-adea-628ae99af559 response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
132024-11-09T01:30:04.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 8dd5a4fd-f1f1-4e16-9614-d0132f3de2ac roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
142024-11-09T01:30:04.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 8dd5a4fd-f1f1-4e16-9614-d0132f3de2ac resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
152024-11-09T01:30:04.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2431 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 8dd5a4fd-f1f1-4e16-9614-d0132f3de2ac response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
162024-11-09T01:30:05.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 94d2de93-1f59-45bd-aeaf-a1f349dbeadf roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
172024-11-09T01:30:05.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 94d2de93-1f59-45bd-aeaf-a1f349dbeadf resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
182024-11-09T01:30:05.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 94d2de93-1f59-45bd-aeaf-a1f349dbeadf response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
192024-11-09T01:30:05.607ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:34511
202024-11-09T01:30:05.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34511 req_id = 5b7ffdf2-b270-4acc-8c13-7203829df848 roles = RoleSet { roles: {} } uri = /metrics/producers
212024-11-09T01:30:05.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34511 req_id = 5b7ffdf2-b270-4acc-8c13-7203829df848 resource = Database result = Ok(()) uri = /metrics/producers
222024-11-09T01:30:05.647ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = 7482031d-4c61-41c0-af62-0f1c419521b3
232024-11-09T01:30:05.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40370 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34511 req_id = 5b7ffdf2-b270-4acc-8c13-7203829df848 response_code = 201 uri = /metrics/producers
242024-11-09T01:30:06.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 531d22fb-586f-4dcc-bfc0-ab0ac1ebbba5 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
252024-11-09T01:30:06.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 531d22fb-586f-4dcc-bfc0-ab0ac1ebbba5 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
262024-11-09T01:30:06.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2580 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 531d22fb-586f-4dcc-bfc0-ab0ac1ebbba5 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
272024-11-09T01:30:07.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6d934e4e-ae1f-4382-9bf5-1cc413943622 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
282024-11-09T01:30:07.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6d934e4e-ae1f-4382-9bf5-1cc413943622 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
292024-11-09T01:30:07.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6d934e4e-ae1f-4382-9bf5-1cc413943622 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
302024-11-09T01:30:08.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c31de4d2-fa1c-4356-bd3e-71946a0e9740 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
312024-11-09T01:30:08.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c31de4d2-fa1c-4356-bd3e-71946a0e9740 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
322024-11-09T01:30:08.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1774 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c31de4d2-fa1c-4356-bd3e-71946a0e9740 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
332024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
342024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
352024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
362024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
372024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
382024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
392024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
402024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
412024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
422024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
432024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
442024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
452024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
462024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
472024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
482024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
492024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
502024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
512024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
522024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
532024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
542024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
552024-11-09T01:30:09.084ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
562024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
572024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
582024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
592024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
602024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
612024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
622024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
632024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
642024-11-09T01:30:09.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
652024-11-09T01:30:09.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
662024-11-09T01:30:09.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
672024-11-09T01:30:09.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
682024-11-09T01:30:09.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
692024-11-09T01:30:09.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
702024-11-09T01:30:09.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
712024-11-09T01:30:09.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
722024-11-09T01:30:09.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
732024-11-09T01:30:09.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.14\u{b5}s iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
742024-11-09T01:30:09.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
752024-11-09T01:30:09.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
762024-11-09T01:30:09.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.61\u{b5}s iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
772024-11-09T01:30:09.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
782024-11-09T01:30:09.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.81\u{b5}s iteration = 16 status = {"errors":[],"records_set_to_done":[]}
792024-11-09T01:30:09.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.95\u{b5}s iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
802024-11-09T01:30:09.087ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1126, tv_nsec: 109047539 } })
812024-11-09T01:30:09.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
822024-11-09T01:30:09.087ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
832024-11-09T01:30:09.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
842024-11-09T01:30:09.088ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.718741ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
852024-11-09T01:30:09.088ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
862024-11-09T01:30:09.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
872024-11-09T01:30:09.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
882024-11-09T01:30:09.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
892024-11-09T01:30:09.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
902024-11-09T01:30:09.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
912024-11-09T01:30:09.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
922024-11-09T01:30:09.091ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
932024-11-09T01:30:09.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
942024-11-09T01:30:09.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
952024-11-09T01:30:09.092ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
962024-11-09T01:30:09.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
972024-11-09T01:30:09.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
982024-11-09T01:30:09.093ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
992024-11-09T01:30:09.094ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1126, tv_nsec: 116631493 } })
1002024-11-09T01:30:09.095ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
1012024-11-09T01:30:09.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1022024-11-09T01:30:09.095ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1032024-11-09T01:30:09.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1042024-11-09T01:30:09.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1052024-11-09T01:30:09.096ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1062024-11-09T01:30:09.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1072024-11-09T01:30:09.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1082024-11-09T01:30:09.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1092024-11-09T01:30:09.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1102024-11-09T01:30:09.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1112024-11-09T01:30:09.100ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1126, tv_nsec: 122542399 } })
1122024-11-09T01:30:09.100ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
1132024-11-09T01:30:09.125ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1142024-11-09T01:30:09.125ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1152024-11-09T01:30:09.125ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1162024-11-09T01:30:09.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1172024-11-09T01:30:09.126ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1182024-11-09T01:30:09.127ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1192024-11-09T01:30:09.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1202024-11-09T01:30:09.128ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1212024-11-09T01:30:09.128ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1222024-11-09T01:30:09.128ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1232024-11-09T01:30:09.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1242024-11-09T01:30:09.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1252024-11-09T01:30:09.129ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1262024-11-09T01:30:09.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1272024-11-09T01:30:09.129ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1282024-11-09T01:30:09.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1292024-11-09T01:30:09.132ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1302024-11-09T01:30:09.132ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1312024-11-09T01:30:09.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1322024-11-09T01:30:09.133ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
1332024-11-09T01:30:09.133ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 48.789074ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
1342024-11-09T01:30:09.135ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1352024-11-09T01:30:09.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1362024-11-09T01:30:09.136ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.911979ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1372024-11-09T01:30:09.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c24f6fb-cc5e-4758-a216-4357bbb5d813, lookup_type: ById(8c24f6fb-cc5e-4758-a216-4357bbb5d813) } result = Ok(())
1382024-11-09T01:30:09.136ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1392024-11-09T01:30:09.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1402024-11-09T01:30:09.137ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1412024-11-09T01:30:09.138ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 54.330686ms iteration = 16 status = 0
1422024-11-09T01:30:09.138ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1432024-11-09T01:30:09.138ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1442024-11-09T01:30:09.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1452024-11-09T01:30:09.139ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1462024-11-09T01:30:09.141ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
1472024-11-09T01:30:09.141ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1482024-11-09T01:30:09.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1492024-11-09T01:30:09.153ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
1502024-11-09T01:30:09.153ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 69.509506ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
1512024-11-09T01:30:09.159ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
1522024-11-09T01:30:09.159ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1532024-11-09T01:30:09.159ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "014fcafc-1ebb-474f-9a09-357112ff0e7e", "content-length": "26", "date": "Sat, 09 Nov 2024 01:30:09 GMT"} })
1542024-11-09T01:30:09.159ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1552024-11-09T01:30:09.159ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1562024-11-09T01:30:09.159ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
1572024-11-09T01:30:09.159ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 75.078477ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
1582024-11-09T01:30:09.160ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1592024-11-09T01:30:09.164ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
1602024-11-09T01:30:09.164ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1612024-11-09T01:30:09.165ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1230a01-abf5-4ddf-8a4a-cf492c7bac19", "content-length": "26", "date": "Sat, 09 Nov 2024 01:30:09 GMT"} })
1622024-11-09T01:30:09.165ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1632024-11-09T01:30:09.166ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.884913ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1642024-11-09T01:30:09.167ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1652024-11-09T01:30:09.171ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba zone_address = fd00:1122:3344:101::2
1662024-11-09T01:30:09.171ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1672024-11-09T01:30:09.171ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "308209c9-68e6-4a59-8e96-932084f8db93", "content-length": "26", "date": "Sat, 09 Nov 2024 01:30:09 GMT"} })
1682024-11-09T01:30:09.171ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1692024-11-09T01:30:09.173ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
1702024-11-09T01:30:09.176ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1712024-11-09T01:30:09.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1722024-11-09T01:30:09.179ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1732024-11-09T01:30:09.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1742024-11-09T01:30:09.194ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1752024-11-09T01:30:09.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1762024-11-09T01:30:09.220ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 135.811564ms iteration = 19 status = {"physical_disks_added":0}
1772024-11-09T01:30:09.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d67a0eb7-2dff-40fa-9d35-c7e367033b64 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
1782024-11-09T01:30:09.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d67a0eb7-2dff-40fa-9d35-c7e367033b64 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
1792024-11-09T01:30:09.233ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 148.822439ms iteration = 16 status = {}
1802024-11-09T01:30:09.234ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
1812024-11-09T01:30:09.234ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3250d92-63e9-497f-b6c3-9795b40d16ec", "content-length": "1", "date": "Sat, 09 Nov 2024 01:30:08 GMT"} })
1822024-11-09T01:30:09.236ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1832024-11-09T01:30:09.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1842024-11-09T01:30:09.277ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
1852024-11-09T01:30:09.277ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1862024-11-09T01:30:09.277ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "56f135b2-4409-42c8-992f-f563662bb3b6", "content-length": "372", "date": "Sat, 09 Nov 2024 01:30:09 GMT"} })
1872024-11-09T01:30:09.277ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1882024-11-09T01:30:09.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1892024-11-09T01:30:09.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d67a0eb7-2dff-40fa-9d35-c7e367033b64 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
1902024-11-09T01:30:09.279ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1912024-11-09T01:30:09.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1922024-11-09T01:30:09.280ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 195.658042ms iteration = 16 status = null
1932024-11-09T01:30:09.281ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1942024-11-09T01:30:09.282ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1952024-11-09T01:30:09.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1962024-11-09T01:30:09.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1972024-11-09T01:30:09.284ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1982024-11-09T01:30:09.286ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1992024-11-09T01:30:09.286ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2002024-11-09T01:30:09.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2012024-11-09T01:30:09.323ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2022024-11-09T01:30:09.324ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
2032024-11-09T01:30:09.324ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
2042024-11-09T01:30:09.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2052024-11-09T01:30:09.324ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9d6cb612-6125-4018-8ed7-6ab0f173a345", "date": "Sat, 09 Nov 2024 01:30:09 GMT"} })
2062024-11-09T01:30:09.324ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2072024-11-09T01:30:09.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2082024-11-09T01:30:09.325ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 68cb9c64-43d4-4c3f-ba7b-013513b8c68d, rack_id: 54080907-d4a8-4f65-b867-da4e2da6d2ba, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8166ae85-b9fa-427c-9f22-e997378e0527) } rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
2092024-11-09T01:30:09.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2102024-11-09T01:30:09.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2112024-11-09T01:30:09.326ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2122024-11-09T01:30:09.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2132024-11-09T01:30:09.329ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2142024-11-09T01:30:09.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2152024-11-09T01:30:09.333ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2162024-11-09T01:30:09.333ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2172024-11-09T01:30:09.333ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1dc48993-2ebb-4194-955c-2fa900edf1af", "date": "Sat, 09 Nov 2024 01:30:09 GMT"} })
2182024-11-09T01:30:09.334ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 249.961357ms iteration = 17 status = {}
2192024-11-09T01:30:09.336ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2202024-11-09T01:30:09.336ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a548828e-f12d-4d9b-8879-34ada2779b7f", "content-length": "134", "date": "Sat, 09 Nov 2024 01:30:08 GMT"} })
2212024-11-09T01:30:09.336ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
2222024-11-09T01:30:09.336ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8166ae85-b9fa-427c-9f22-e997378e0527
2232024-11-09T01:30:09.337ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
2242024-11-09T01:30:09.337ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2252024-11-09T01:30:09.337ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2262024-11-09T01:30:09.337ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2272024-11-09T01:30:09.337ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2282024-11-09T01:30:09.337ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2292024-11-09T01:30:09.337ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2302024-11-09T01:30:09.337ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2312024-11-09T01:30:09.337ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
2322024-11-09T01:30:09.337ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2332024-11-09T01:30:09.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2342024-11-09T01:30:09.339ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2352024-11-09T01:30:09.339ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "560c1a02-a190-4f47-9c0a-39f874c6104f", "content-length": "2", "date": "Sat, 09 Nov 2024 01:30:08 GMT"} })
2362024-11-09T01:30:09.339ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2372024-11-09T01:30:09.339ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d79d756-4514-4957-b9f3-e28a500729f0", "content-length": "52", "date": "Sat, 09 Nov 2024 01:30:08 GMT"} })
2382024-11-09T01:30:09.339ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
2392024-11-09T01:30:09.339ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2402024-11-09T01:30:09.374ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2412024-11-09T01:30:09.441ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f3e72ea3-6fb6-4d91-a917-61e50f4d9bba", "date": "Sat, 09 Nov 2024 01:30:09 GMT"} })
2422024-11-09T01:30:09.441ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch = Switch0
2432024-11-09T01:30:09.441ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
2442024-11-09T01:30:09.441ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ead43cca-b1c7-4ee7-b740-dc2f8e754e9a", "content-length": "691", "date": "Sat, 09 Nov 2024 01:30:09 GMT"} })
2452024-11-09T01:30:09.441ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
2462024-11-09T01:30:09.441ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
2472024-11-09T01:30:09.441ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
2482024-11-09T01:30:09.441ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d6503d3-110e-44eb-a9e4-014700086520", "content-length": "682", "date": "Sat, 09 Nov 2024 01:30:09 GMT"} })
2492024-11-09T01:30:09.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2502024-11-09T01:30:09.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2512024-11-09T01:30:09.443ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 358.848072ms iteration = 16 status = {}
2522024-11-09T01:30:09.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2532024-11-09T01:30:09.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2542024-11-09T01:30:09.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2552024-11-09T01:30:09.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2562024-11-09T01:30:09.449ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2572024-11-09T01:30:09.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2582024-11-09T01:30:09.455ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:44994
2592024-11-09T01:30:09.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44994 req_id = f617ec39-d75c-44bf-b0aa-360e5c5c6385 roles = RoleSet { roles: {} } uri = /metrics/producers
2602024-11-09T01:30:09.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44994 req_id = f617ec39-d75c-44bf-b0aa-360e5c5c6385 resource = Database result = Ok(()) uri = /metrics/producers
2612024-11-09T01:30:09.456ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 372.104809ms iteration = 16 status = {}
2622024-11-09T01:30:09.465ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = 0b7e3a2a-2678-430a-9e61-79da480570a8
2632024-11-09T01:30:09.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9847 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44994 req_id = f617ec39-d75c-44bf-b0aa-360e5c5c6385 response_code = 201 uri = /metrics/producers
2642024-11-09T01:30:10.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 94a4ac9e-3352-477b-9071-ba88b7e44e57 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
2652024-11-09T01:30:10.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 94a4ac9e-3352-477b-9071-ba88b7e44e57 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
2662024-11-09T01:30:10.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 94a4ac9e-3352-477b-9071-ba88b7e44e57 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
2672024-11-09T01:30:10.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 27e82fa4-a01f-42af-bf62-8f0469f85213 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
2682024-11-09T01:30:10.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 27e82fa4-a01f-42af-bf62-8f0469f85213 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
2692024-11-09T01:30:10.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 27e82fa4-a01f-42af-bf62-8f0469f85213 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
2702024-11-09T01:30:11.159ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:52748
2712024-11-09T01:30:11.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52748 req_id = 6253448c-e7f9-45c8-8141-dd2bacb054d9 roles = RoleSet { roles: {} } uri = /metrics/producers
2722024-11-09T01:30:11.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52748 req_id = 6253448c-e7f9-45c8-8141-dd2bacb054d9 resource = Database result = Ok(()) uri = /metrics/producers
2732024-11-09T01:30:11.194ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
2742024-11-09T01:30:11.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35666 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52748 req_id = 6253448c-e7f9-45c8-8141-dd2bacb054d9 response_code = 201 uri = /metrics/producers
2752024-11-09T01:30:11.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 940a3cf0-c404-4174-a46d-361af3f01810 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
2762024-11-09T01:30:11.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 940a3cf0-c404-4174-a46d-361af3f01810 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
2772024-11-09T01:30:11.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2289 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 940a3cf0-c404-4174-a46d-361af3f01810 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
2782024-11-09T01:30:12.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 96e99bb8-2903-49f9-a03f-23b5f0d6b5a0 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
2792024-11-09T01:30:12.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 96e99bb8-2903-49f9-a03f-23b5f0d6b5a0 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
2802024-11-09T01:30:12.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 96e99bb8-2903-49f9-a03f-23b5f0d6b5a0 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
2812024-11-09T01:30:13.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 86413deb-1296-4c8a-a7ab-f557386c0c49 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
2822024-11-09T01:30:13.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 86413deb-1296-4c8a-a7ab-f557386c0c49 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
2832024-11-09T01:30:13.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1863 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 86413deb-1296-4c8a-a7ab-f557386c0c49 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
2842024-11-09T01:30:14.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c10ef30e-34b3-43d0-bddd-db6c37e9e730 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
2852024-11-09T01:30:14.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c10ef30e-34b3-43d0-bddd-db6c37e9e730 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
2862024-11-09T01:30:14.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c10ef30e-34b3-43d0-bddd-db6c37e9e730 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
2872024-11-09T01:30:14.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1292 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = 1d3fb022-43c9-49d3-965d-8c3279ec224b response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
2882024-11-09T01:30:15.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f2367b2c-5265-4843-824a-c8aca8831f3a roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
2892024-11-09T01:30:15.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f2367b2c-5265-4843-824a-c8aca8831f3a resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
2902024-11-09T01:30:15.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1946 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f2367b2c-5265-4843-824a-c8aca8831f3a response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
2912024-11-09T01:30:15.692ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:44793
2922024-11-09T01:30:15.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44793 req_id = 028e4c0a-6270-4f21-af4e-2bc6c86b3b69 roles = RoleSet { roles: {} } uri = /metrics/producers
2932024-11-09T01:30:15.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44793 req_id = 028e4c0a-6270-4f21-af4e-2bc6c86b3b69 resource = Database result = Ok(()) uri = /metrics/producers
2942024-11-09T01:30:15.734ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = ae2532a5-1acb-4cb0-9e42-a49469d3ac6e
2952024-11-09T01:30:15.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41465 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44793 req_id = 028e4c0a-6270-4f21-af4e-2bc6c86b3b69 response_code = 201 uri = /metrics/producers
2962024-11-09T01:30:16.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4792a44d-4030-4c73-ab95-f41a1e011f68 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
2972024-11-09T01:30:16.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4792a44d-4030-4c73-ab95-f41a1e011f68 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
2982024-11-09T01:30:16.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4792a44d-4030-4c73-ab95-f41a1e011f68 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
2992024-11-09T01:30:17.198ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:53103
3002024-11-09T01:30:17.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53103 req_id = 6faf8871-0f28-488c-aa76-c0b72206a809 roles = RoleSet { roles: {} } uri = /metrics/producers
3012024-11-09T01:30:17.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53103 req_id = 6faf8871-0f28-488c-aa76-c0b72206a809 resource = Database result = Ok(()) uri = /metrics/producers
3022024-11-09T01:30:17.242ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = 280d8787-5c87-4881-b4ab-42b6418a5800
3032024-11-09T01:30:17.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44037 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53103 req_id = 6faf8871-0f28-488c-aa76-c0b72206a809 response_code = 201 uri = /metrics/producers
3042024-11-09T01:30:17.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 1342d96e-f064-4595-8a1f-56ff17d70c2a roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3052024-11-09T01:30:17.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 1342d96e-f064-4595-8a1f-56ff17d70c2a resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3062024-11-09T01:30:17.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2014 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 1342d96e-f064-4595-8a1f-56ff17d70c2a response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3072024-11-09T01:30:18.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c96c2745-2b65-4645-8662-3f0be8ca7d2f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3082024-11-09T01:30:18.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c96c2745-2b65-4645-8662-3f0be8ca7d2f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3092024-11-09T01:30:18.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c96c2745-2b65-4645-8662-3f0be8ca7d2f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3102024-11-09T01:30:18.782ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:37479
3112024-11-09T01:30:18.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37479 req_id = ea40eeec-8606-4a13-a98e-004b3a432f25 roles = RoleSet { roles: {} } uri = /metrics/producers
3122024-11-09T01:30:18.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37479 req_id = ea40eeec-8606-4a13-a98e-004b3a432f25 resource = Database result = Ok(()) uri = /metrics/producers
3132024-11-09T01:30:18.836ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = 48c53f41-2154-4790-bde9-4c822a898bb2
3142024-11-09T01:30:18.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54207 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37479 req_id = ea40eeec-8606-4a13-a98e-004b3a432f25 response_code = 201 uri = /metrics/producers
3152024-11-09T01:30:19.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
3162024-11-09T01:30:19.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
3172024-11-09T01:30:19.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3182024-11-09T01:30:19.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3192024-11-09T01:30:19.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3202024-11-09T01:30:19.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3212024-11-09T01:30:19.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3222024-11-09T01:30:19.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3232024-11-09T01:30:19.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3242024-11-09T01:30:19.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.198307ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3252024-11-09T01:30:19.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3262024-11-09T01:30:19.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3272024-11-09T01:30:19.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3282024-11-09T01:30:19.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3292024-11-09T01:30:19.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3302024-11-09T01:30:19.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3312024-11-09T01:30:19.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
3322024-11-09T01:30:19.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3332024-11-09T01:30:19.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3342024-11-09T01:30:19.109ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
3352024-11-09T01:30:19.109ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.041429ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
3362024-11-09T01:30:19.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f6ef27d9-cf8d-49dd-849d-34cdcd8c6762 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3372024-11-09T01:30:19.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f6ef27d9-cf8d-49dd-849d-34cdcd8c6762 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3382024-11-09T01:30:19.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1826 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f6ef27d9-cf8d-49dd-849d-34cdcd8c6762 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3392024-11-09T01:30:20.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0e6383d8-0b39-40d2-98f0-a5afd5b5f74e roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3402024-11-09T01:30:20.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0e6383d8-0b39-40d2-98f0-a5afd5b5f74e resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3412024-11-09T01:30:20.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0e6383d8-0b39-40d2-98f0-a5afd5b5f74e response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3422024-11-09T01:30:21.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b80ed62c-5129-4246-b15b-d5eeefe5b19a roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3432024-11-09T01:30:21.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b80ed62c-5129-4246-b15b-d5eeefe5b19a resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3442024-11-09T01:30:21.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1853 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b80ed62c-5129-4246-b15b-d5eeefe5b19a response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3452024-11-09T01:30:22.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d989255d-a81f-4e8d-b712-1e1ec49e408a roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3462024-11-09T01:30:22.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d989255d-a81f-4e8d-b712-1e1ec49e408a resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3472024-11-09T01:30:22.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2311 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d989255d-a81f-4e8d-b712-1e1ec49e408a response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3482024-11-09T01:30:23.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9d0c2ed2-8ee9-4656-9067-96f80789ad16 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3492024-11-09T01:30:23.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9d0c2ed2-8ee9-4656-9067-96f80789ad16 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3502024-11-09T01:30:23.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9d0c2ed2-8ee9-4656-9067-96f80789ad16 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3512024-11-09T01:30:24.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b8f58b34-9922-4a6a-81b6-29875dfa5830 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3522024-11-09T01:30:24.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b8f58b34-9922-4a6a-81b6-29875dfa5830 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3532024-11-09T01:30:24.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b8f58b34-9922-4a6a-81b6-29875dfa5830 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3542024-11-09T01:30:25.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d7a98f24-7cc5-4c87-bc5d-0ac399f3c653 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3552024-11-09T01:30:25.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d7a98f24-7cc5-4c87-bc5d-0ac399f3c653 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3562024-11-09T01:30:25.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d7a98f24-7cc5-4c87-bc5d-0ac399f3c653 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3572024-11-09T01:30:26.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7f08d6f7-e59e-4575-9088-958f083cd381 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3582024-11-09T01:30:26.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7f08d6f7-e59e-4575-9088-958f083cd381 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3592024-11-09T01:30:26.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1739 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7f08d6f7-e59e-4575-9088-958f083cd381 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3602024-11-09T01:30:27.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c2223556-80b9-4760-ad91-8fae0c20f11b roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3612024-11-09T01:30:27.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c2223556-80b9-4760-ad91-8fae0c20f11b resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3622024-11-09T01:30:27.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c2223556-80b9-4760-ad91-8fae0c20f11b response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3632024-11-09T01:30:28.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c50e6e55-51df-4be6-81a4-85c1212473f6 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3642024-11-09T01:30:28.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c50e6e55-51df-4be6-81a4-85c1212473f6 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3652024-11-09T01:30:28.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c50e6e55-51df-4be6-81a4-85c1212473f6 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3662024-11-09T01:30:29.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
3672024-11-09T01:30:29.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3682024-11-09T01:30:29.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
3692024-11-09T01:30:29.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3702024-11-09T01:30:29.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3712024-11-09T01:30:29.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3722024-11-09T01:30:29.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3732024-11-09T01:30:29.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3742024-11-09T01:30:29.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3752024-11-09T01:30:29.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3762024-11-09T01:30:29.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3772024-11-09T01:30:29.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3782024-11-09T01:30:29.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3792024-11-09T01:30:29.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3802024-11-09T01:30:29.093ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 8.91995ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3812024-11-09T01:30:29.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3822024-11-09T01:30:29.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
3832024-11-09T01:30:29.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3842024-11-09T01:30:29.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3852024-11-09T01:30:29.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
3862024-11-09T01:30:29.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.796224ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
3872024-11-09T01:30:29.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c255ca44-5b96-4ac5-a63a-e73f423fd28c roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3882024-11-09T01:30:29.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c255ca44-5b96-4ac5-a63a-e73f423fd28c resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3892024-11-09T01:30:29.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2007 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c255ca44-5b96-4ac5-a63a-e73f423fd28c response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3902024-11-09T01:30:29.970ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1267 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = 7fac1abc-b189-4006-b816-e0b934840160 response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
3912024-11-09T01:30:30.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ec1d4436-d475-4d6b-854a-86a6593e00de roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3922024-11-09T01:30:30.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ec1d4436-d475-4d6b-854a-86a6593e00de resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3932024-11-09T01:30:30.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ec1d4436-d475-4d6b-854a-86a6593e00de response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3942024-11-09T01:30:31.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4ed64893-05f6-4add-b11f-417a16bcb1e7 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3952024-11-09T01:30:31.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4ed64893-05f6-4add-b11f-417a16bcb1e7 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3962024-11-09T01:30:31.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4ed64893-05f6-4add-b11f-417a16bcb1e7 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3972024-11-09T01:30:32.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3486da3a-e8d5-4543-80bc-09ceaca58390 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3982024-11-09T01:30:32.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3486da3a-e8d5-4543-80bc-09ceaca58390 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
3992024-11-09T01:30:32.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3486da3a-e8d5-4543-80bc-09ceaca58390 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
4002024-11-09T01:30:33.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 468b7379-e17b-400c-a60b-ff4e502ec2a5 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
4012024-11-09T01:30:33.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 468b7379-e17b-400c-a60b-ff4e502ec2a5 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
4022024-11-09T01:30:33.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 468b7379-e17b-400c-a60b-ff4e502ec2a5 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
4032024-11-09T01:30:34.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 30f302fc-205c-460c-8562-d64408d1c556 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
4042024-11-09T01:30:34.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 30f302fc-205c-460c-8562-d64408d1c556 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
4052024-11-09T01:30:34.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2612 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 30f302fc-205c-460c-8562-d64408d1c556 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
4062024-11-09T01:30:34.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 5b0fd361-6b67-4e2e-9628-c96008d48b7f roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
4072024-11-09T01:30:34.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 5b0fd361-6b67-4e2e-9628-c96008d48b7f resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
4082024-11-09T01:30:34.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 5b0fd361-6b67-4e2e-9628-c96008d48b7f response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
4092024-11-09T01:30:34.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 17c7d9cc-f2e3-4173-aeb2-dfbbd931eae7 roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
4102024-11-09T01:30:34.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 17c7d9cc-f2e3-4173-aeb2-dfbbd931eae7 resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
4112024-11-09T01:30:34.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 17c7d9cc-f2e3-4173-aeb2-dfbbd931eae7 response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
4122024-11-09T01:30:35.327ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
4132024-11-09T01:30:35.327ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
4142024-11-09T01:30:35.357ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
4152024-11-09T01:30:35.358ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:32914
4162024-11-09T01:30:35.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:32914 req_id = 12807e50-33e8-4a71-98af-8f37c344082b roles = RoleSet { roles: {} } uri = /metrics/producers
4172024-11-09T01:30:35.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:32914 req_id = 12807e50-33e8-4a71-98af-8f37c344082b resource = Database result = Ok(()) uri = /metrics/producers
4182024-11-09T01:30:35.368ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
4192024-11-09T01:30:35.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10077 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:32914 req_id = 12807e50-33e8-4a71-98af-8f37c344082b response_code = 201 uri = /metrics/producers
4202024-11-09T01:30:35.368ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "12807e50-33e8-4a71-98af-8f37c344082b", "content-length": "41", "date": "Sat, 09 Nov 2024 01:30:34 GMT"} })
4212024-11-09T01:30:35.369ZDEBGnexus (producer-registration-task): registered with nexus successfully
4222024-11-09T01:30:35.369ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
4232024-11-09T01:30:35.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5dab2d1f-30be-4adb-8e47-33f02d189e55 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
4242024-11-09T01:30:35.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5dab2d1f-30be-4adb-8e47-33f02d189e55 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
4252024-11-09T01:30:35.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5dab2d1f-30be-4adb-8e47-33f02d189e55 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
4262024-11-09T01:30:36.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e9f46553-8359-4c60-b347-3b45cb05927b roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
4272024-11-09T01:30:36.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e9f46553-8359-4c60-b347-3b45cb05927b resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
4282024-11-09T01:30:36.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2501 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e9f46553-8359-4c60-b347-3b45cb05927b response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
4292024-11-09T01:30:37.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7f81548f-a71e-4200-b564-ee88235884ec roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
4302024-11-09T01:30:37.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7f81548f-a71e-4200-b564-ee88235884ec resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
4312024-11-09T01:30:37.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7f81548f-a71e-4200-b564-ee88235884ec response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
4322024-11-09T01:30:38.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b0b19628-c0c0-455c-89aa-a122272e79b5 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
4332024-11-09T01:30:38.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b0b19628-c0c0-455c-89aa-a122272e79b5 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
4342024-11-09T01:30:38.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2350 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b0b19628-c0c0-455c-89aa-a122272e79b5 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
4352024-11-09T01:30:39.084ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
4362024-11-09T01:30:39.084ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
4372024-11-09T01:30:39.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4382024-11-09T01:30:39.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
4392024-11-09T01:30:39.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4402024-11-09T01:30:39.084ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
4412024-11-09T01:30:39.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
4422024-11-09T01:30:39.084ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4432024-11-09T01:30:39.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4442024-11-09T01:30:39.084ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
4452024-11-09T01:30:39.084ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
4462024-11-09T01:30:39.084ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4472024-11-09T01:30:39.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4482024-11-09T01:30:39.084ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
4492024-11-09T01:30:39.084ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
4502024-11-09T01:30:39.084ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4512024-11-09T01:30:39.084ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
4522024-11-09T01:30:39.084ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4532024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4542024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
4552024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
4562024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
4572024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4582024-11-09T01:30:39.085ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 01:20:39.085044920 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4592024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
4602024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4612024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
4622024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
4632024-11-09T01:30:39.085ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079
4642024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
4652024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.991\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079"}
4662024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4672024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4682024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
4692024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
4702024-11-09T01:30:39.085ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4712024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4722024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4732024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4742024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
4752024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
4762024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4772024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4782024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
4792024-11-09T01:30:39.085ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4802024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4812024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
4822024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4832024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4842024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
4852024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4862024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
4872024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 10.36\u{b5}s iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
4882024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
4892024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
4902024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.47\u{b5}s iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
4912024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4922024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
4932024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
4942024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.03\u{b5}s iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
4952024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.381\u{b5}s iteration = 17 status = {"errors":[],"records_set_to_done":[]}
4962024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
4972024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4982024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4992024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5002024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5012024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5022024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5032024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5042024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5052024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5062024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5072024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5082024-11-09T01:30:39.085ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("34219892-cef8-4169-a366-ce17844120f6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("530f76d0-bec9-4ae0-beb0-d217f68ae05a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("530f76d0-bec9-4ae0-beb0-d217f68ae05a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1156, tv_nsec: 107337650 } })
5092024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5102024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5112024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5122024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5132024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5142024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5152024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5162024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5172024-11-09T01:30:39.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5182024-11-09T01:30:39.085ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("30d356ab-a881-4ca3-8f43-203be0381a68.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d55caa1f-cc37-4ecb-b8bf-58b9052db1d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d55caa1f-cc37-4ecb-b8bf-58b9052db1d9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1156, tv_nsec: 107434781 } })
5192024-11-09T01:30:39.086ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
5202024-11-09T01:30:39.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.140173ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
5212024-11-09T01:30:39.086ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
5222024-11-09T01:30:39.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.163773ms iteration = 10 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
5232024-11-09T01:30:39.087ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5242024-11-09T01:30:39.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5252024-11-09T01:30:39.088ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5262024-11-09T01:30:39.088ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1156, tv_nsec: 110582286 } })
5272024-11-09T01:30:39.089ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
5282024-11-09T01:30:39.089ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.123036ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5292024-11-09T01:30:39.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5302024-11-09T01:30:39.090ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5312024-11-09T01:30:39.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5322024-11-09T01:30:39.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5332024-11-09T01:30:39.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5342024-11-09T01:30:39.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5352024-11-09T01:30:39.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5362024-11-09T01:30:39.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5372024-11-09T01:30:39.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5382024-11-09T01:30:39.093ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5392024-11-09T01:30:39.093ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5402024-11-09T01:30:39.093ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5412024-11-09T01:30:39.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5422024-11-09T01:30:39.094ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5432024-11-09T01:30:39.094ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
5442024-11-09T01:30:39.094ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 01:20:39.085044920 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5452024-11-09T01:30:39.094ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.931701ms iteration = 9 status = {"expiration":"2024-11-09T01:20:39.085044920Z","pruned":[]}
5462024-11-09T01:30:39.095ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1156, tv_nsec: 116769135 } })
5472024-11-09T01:30:39.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5482024-11-09T01:30:39.095ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
5492024-11-09T01:30:39.095ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5502024-11-09T01:30:39.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5512024-11-09T01:30:39.096ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5522024-11-09T01:30:39.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5532024-11-09T01:30:39.097ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5542024-11-09T01:30:39.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5552024-11-09T01:30:39.097ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5562024-11-09T01:30:39.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5572024-11-09T01:30:39.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5582024-11-09T01:30:39.098ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5592024-11-09T01:30:39.099ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5602024-11-09T01:30:39.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5612024-11-09T01:30:39.099ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5622024-11-09T01:30:39.100ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5632024-11-09T01:30:39.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5642024-11-09T01:30:39.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5652024-11-09T01:30:39.101ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.738495ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
5662024-11-09T01:30:39.101ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5672024-11-09T01:30:39.101ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5682024-11-09T01:30:39.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5692024-11-09T01:30:39.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5702024-11-09T01:30:39.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5712024-11-09T01:30:39.103ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1156, tv_nsec: 125215309 } })
5722024-11-09T01:30:39.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5732024-11-09T01:30:39.103ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
5742024-11-09T01:30:39.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5752024-11-09T01:30:39.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5762024-11-09T01:30:39.105ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
5772024-11-09T01:30:39.105ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
5782024-11-09T01:30:39.105ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 20.761402ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
5792024-11-09T01:30:39.107ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5802024-11-09T01:30:39.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5812024-11-09T01:30:39.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5822024-11-09T01:30:39.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5832024-11-09T01:30:39.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
5842024-11-09T01:30:39.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5852024-11-09T01:30:39.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5862024-11-09T01:30:39.113ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5872024-11-09T01:30:39.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5882024-11-09T01:30:39.113ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5892024-11-09T01:30:39.118ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
5902024-11-09T01:30:39.118ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 33.096389ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
5912024-11-09T01:30:39.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5922024-11-09T01:30:39.118ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5932024-11-09T01:30:39.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5942024-11-09T01:30:39.126ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5952024-11-09T01:30:39.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5962024-11-09T01:30:39.128ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
5972024-11-09T01:30:39.128ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.536095ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
5982024-11-09T01:30:39.129ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.296494ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5992024-11-09T01:30:39.129ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6002024-11-09T01:30:39.132ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6012024-11-09T01:30:39.132ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6022024-11-09T01:30:39.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6032024-11-09T01:30:39.133ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6042024-11-09T01:30:39.133ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6052024-11-09T01:30:39.133ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 47.763073ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6062024-11-09T01:30:39.135ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6072024-11-09T01:30:39.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6082024-11-09T01:30:39.136ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6092024-11-09T01:30:39.137ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6102024-11-09T01:30:39.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6112024-11-09T01:30:39.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6122024-11-09T01:30:39.138ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6132024-11-09T01:30:39.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6142024-11-09T01:30:39.141ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6152024-11-09T01:30:39.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6162024-11-09T01:30:39.143ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6172024-11-09T01:30:39.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6182024-11-09T01:30:39.145ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6192024-11-09T01:30:39.145ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6202024-11-09T01:30:39.146ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6212024-11-09T01:30:39.146ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6222024-11-09T01:30:39.146ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6232024-11-09T01:30:39.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6242024-11-09T01:30:39.147ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6252024-11-09T01:30:39.147ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6262024-11-09T01:30:39.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6272024-11-09T01:30:39.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c24f6fb-cc5e-4758-a216-4357bbb5d813, lookup_type: ById(8c24f6fb-cc5e-4758-a216-4357bbb5d813) } result = Ok(())
6282024-11-09T01:30:39.148ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6292024-11-09T01:30:39.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6302024-11-09T01:30:39.149ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6312024-11-09T01:30:39.149ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6322024-11-09T01:30:39.149ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 64.219427ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6332024-11-09T01:30:39.149ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6342024-11-09T01:30:39.150ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 65.791674ms iteration = 17 status = 0
6352024-11-09T01:30:39.151ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6362024-11-09T01:30:39.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6372024-11-09T01:30:39.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6382024-11-09T01:30:39.153ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
6392024-11-09T01:30:39.153ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
6402024-11-09T01:30:39.153ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
6412024-11-09T01:30:39.153ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6422024-11-09T01:30:39.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6432024-11-09T01:30:39.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 83.950666ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6442024-11-09T01:30:39.188ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
6452024-11-09T01:30:39.188ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
6462024-11-09T01:30:39.188ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
6472024-11-09T01:30:39.188ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6482024-11-09T01:30:39.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6492024-11-09T01:30:39.216ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
6502024-11-09T01:30:39.216ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 131.428575ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
6512024-11-09T01:30:39.224ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6522024-11-09T01:30:39.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6532024-11-09T01:30:39.239ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 154.404342ms iteration = 20 status = {"physical_disks_added":0}
6542024-11-09T01:30:39.267ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
6552024-11-09T01:30:39.267ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6562024-11-09T01:30:39.268ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c0805f2-1648-44d7-8be8-576998157770", "content-length": "26", "date": "Sat, 09 Nov 2024 01:30:39 GMT"} })
6572024-11-09T01:30:39.268ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6582024-11-09T01:30:39.270ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6592024-11-09T01:30:39.286ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
6602024-11-09T01:30:39.286ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6612024-11-09T01:30:39.286ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f33b153-c944-4a3a-bd38-27114efcaa8c", "content-length": "26", "date": "Sat, 09 Nov 2024 01:30:39 GMT"} })
6622024-11-09T01:30:39.286ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6632024-11-09T01:30:39.288ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6642024-11-09T01:30:39.343ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
6652024-11-09T01:30:39.344ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
6662024-11-09T01:30:39.399ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba zone_address = fd00:1122:3344:101::2
6672024-11-09T01:30:39.399ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6682024-11-09T01:30:39.400ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd8559c9-32c1-4f65-bb4e-14e285071f17", "content-length": "26", "date": "Sat, 09 Nov 2024 01:30:39 GMT"} })
6692024-11-09T01:30:39.400ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6702024-11-09T01:30:39.401ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
6712024-11-09T01:30:39.465ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6722024-11-09T01:30:39.466ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6255a8d-34f1-4661-90ce-26ea631ffdfd", "content-length": "1", "date": "Sat, 09 Nov 2024 01:30:39 GMT"} })
6732024-11-09T01:30:39.466ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6742024-11-09T01:30:39.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6752024-11-09T01:30:39.520ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
6762024-11-09T01:30:39.521ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d8a18862-57d2-4af8-bd1d-d16672b00e72", "date": "Sat, 09 Nov 2024 01:30:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
6772024-11-09T01:30:39.521ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
6782024-11-09T01:30:39.522ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1f181079-0f14-4e06-be69-be91c59d0120", "date": "Sat, 09 Nov 2024 01:30:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
6792024-11-09T01:30:39.522ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
6802024-11-09T01:30:39.524ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
6812024-11-09T01:30:39.524ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 439.540551ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
6822024-11-09T01:30:39.560ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
6832024-11-09T01:30:39.560ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
6842024-11-09T01:30:39.560ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2288fb2-903c-474f-9cd0-408143504791", "content-length": "372", "date": "Sat, 09 Nov 2024 01:30:39 GMT"} })
6852024-11-09T01:30:39.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6862024-11-09T01:30:39.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6872024-11-09T01:30:39.562ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6882024-11-09T01:30:39.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6892024-11-09T01:30:39.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6902024-11-09T01:30:39.563ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6912024-11-09T01:30:39.566ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6922024-11-09T01:30:39.566ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6932024-11-09T01:30:39.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6942024-11-09T01:30:39.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6952024-11-09T01:30:39.567ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6962024-11-09T01:30:39.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6972024-11-09T01:30:39.567ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6982024-11-09T01:30:39.567ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6992024-11-09T01:30:39.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7002024-11-09T01:30:39.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7012024-11-09T01:30:39.568ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7022024-11-09T01:30:39.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7032024-11-09T01:30:39.569ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 484.063866ms iteration = 17 status = null
7042024-11-09T01:30:39.570ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7052024-11-09T01:30:39.572ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7062024-11-09T01:30:39.572ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7072024-11-09T01:30:39.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7082024-11-09T01:30:39.578ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
7092024-11-09T01:30:39.578ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 72269a3a-73dc-4fb3-8a06-f7b406523664 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
7102024-11-09T01:30:39.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7112024-11-09T01:30:39.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7122024-11-09T01:30:39.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7132024-11-09T01:30:39.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7142024-11-09T01:30:39.583ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7152024-11-09T01:30:39.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7162024-11-09T01:30:39.586ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 72269a3a-73dc-4fb3-8a06-f7b406523664 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
7172024-11-09T01:30:39.586ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
7182024-11-09T01:30:39.586ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 01:23:03.098267 UTC dns_group = internal generation = 1
7192024-11-09T01:30:39.586ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 501.284099ms iteration = 10 status = {"generation":1}
7202024-11-09T01:30:39.605ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
7212024-11-09T01:30:39.605ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7222024-11-09T01:30:39.606ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "46017e79-49c8-4238-9ac1-9b171824cf06", "date": "Sat, 09 Nov 2024 01:30:39 GMT"} })
7232024-11-09T01:30:39.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7242024-11-09T01:30:39.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7252024-11-09T01:30:39.607ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
7262024-11-09T01:30:39.607ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = dadc16e6-e16c-4c3f-bb19-4f189e9d1c26 dns_zone_name = oxide.test found_so_far = 0 version = 2
7272024-11-09T01:30:39.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7282024-11-09T01:30:39.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7292024-11-09T01:30:39.609ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7302024-11-09T01:30:39.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7312024-11-09T01:30:39.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7322024-11-09T01:30:39.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7332024-11-09T01:30:39.613ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7342024-11-09T01:30:39.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7352024-11-09T01:30:39.624ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T01:22:35.233443Z, time_modified: 2024-11-09T01:22:35.233443Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 539ccef2-8207-42b1-9e05-00e0a1387c35, db_silo: Silo { identity: SiloIdentity { id: 539ccef2-8207-42b1-9e05-00e0a1387c35, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T01:23:03.926223Z, time_modified: 2024-11-09T01:23:03.926223Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 539ccef2-8207-42b1-9e05-00e0a1387c35, db_silo: Silo { identity: SiloIdentity { id: 539ccef2-8207-42b1-9e05-00e0a1387c35, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T01:23:03.926223Z, time_modified: 2024-11-09T01:23:03.926223Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248" }] }) }
7362024-11-09T01:30:39.624ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 539.545095ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"539ccef2-8207-42b1-9e05-00e0a1387c35","tls_certs":["22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248"]}},"default_endpoint":{"silo_id":"539ccef2-8207-42b1-9e05-00e0a1387c35","tls_certs":["22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
7372024-11-09T01:30:39.653ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 568.215635ms iteration = 17 status = {}
7382024-11-09T01:30:39.676ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
7392024-11-09T01:30:39.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7402024-11-09T01:30:39.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7412024-11-09T01:30:39.803ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7422024-11-09T01:30:39.803ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad068eb8-f378-4537-90e8-727c3f37bf13", "content-length": "691", "date": "Sat, 09 Nov 2024 01:30:39 GMT"} })
7432024-11-09T01:30:39.803ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
7442024-11-09T01:30:39.803ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
7452024-11-09T01:30:39.803ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
7462024-11-09T01:30:39.805ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 720.685945ms iteration = 17 status = {}
7472024-11-09T01:30:39.806ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = dadc16e6-e16c-4c3f-bb19-4f189e9d1c26 dns_zone_name = oxide.test found_so_far = 1 version = 2
7482024-11-09T01:30:39.806ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
7492024-11-09T01:30:39.806ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 01:23:03.974860 UTC dns_group = external generation = 2
7502024-11-09T01:30:39.806ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 720.827057ms iteration = 10 status = {"generation":2}
7512024-11-09T01:30:39.806ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 68cb9c64-43d4-4c3f-ba7b-013513b8c68d, rack_id: 54080907-d4a8-4f65-b867-da4e2da6d2ba, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8166ae85-b9fa-427c-9f22-e997378e0527) } rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
7522024-11-09T01:30:39.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7532024-11-09T01:30:39.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7542024-11-09T01:30:39.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7552024-11-09T01:30:39.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7562024-11-09T01:30:39.815ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7572024-11-09T01:30:39.815ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7582024-11-09T01:30:39.816ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "413a93e5-2334-461f-99b4-8008737fc55f", "date": "Sat, 09 Nov 2024 01:30:39 GMT"} })
7592024-11-09T01:30:39.817ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
7602024-11-09T01:30:39.818ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "00752f9f-ec79-4fd2-95e7-27f70d02cf26", "date": "Sat, 09 Nov 2024 01:30:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
7612024-11-09T01:30:39.818ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
7622024-11-09T01:30:39.818ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 733.594439ms iteration = 18 status = {}
7632024-11-09T01:30:39.820ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "24666ec2-77fd-49e1-9b04-1ecd5eefc450", "date": "Sat, 09 Nov 2024 01:30:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
7642024-11-09T01:30:39.820ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
7652024-11-09T01:30:39.822ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e2866668-1783-48b3-abc4-94cba596f402", "date": "Sat, 09 Nov 2024 01:30:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
7662024-11-09T01:30:39.822ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
7672024-11-09T01:30:39.824ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
7682024-11-09T01:30:39.824ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 739.485625ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
7692024-11-09T01:30:39.837ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
7702024-11-09T01:30:39.837ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa28afc1-e907-46e0-9edb-8d5f3f5fed3f", "content-length": "134", "date": "Sat, 09 Nov 2024 01:30:39 GMT"} })
7712024-11-09T01:30:39.837ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
7722024-11-09T01:30:39.837ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8166ae85-b9fa-427c-9f22-e997378e0527
7732024-11-09T01:30:39.838ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
7742024-11-09T01:30:39.838ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
7752024-11-09T01:30:39.838ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7762024-11-09T01:30:39.838ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7772024-11-09T01:30:39.838ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7782024-11-09T01:30:39.838ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7792024-11-09T01:30:39.838ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7802024-11-09T01:30:39.838ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7812024-11-09T01:30:39.838ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
7822024-11-09T01:30:39.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7832024-11-09T01:30:39.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7842024-11-09T01:30:39.841ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
7852024-11-09T01:30:39.842ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7d573ec-d7a3-43a5-9ec9-960fbd0b1ac7", "content-length": "2", "date": "Sat, 09 Nov 2024 01:30:39 GMT"} })
7862024-11-09T01:30:39.842ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
7872024-11-09T01:30:39.842ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d866df2-6b47-4f6f-a8be-adf02975a46d", "content-length": "52", "date": "Sat, 09 Nov 2024 01:30:39 GMT"} })
7882024-11-09T01:30:39.842ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
7892024-11-09T01:30:39.842ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
7902024-11-09T01:30:39.973ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2f70619d-e735-460e-a36c-72a3dd00399a", "date": "Sat, 09 Nov 2024 01:30:39 GMT"} })
7912024-11-09T01:30:39.973ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch = Switch0
7922024-11-09T01:30:39.973ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
7932024-11-09T01:30:39.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 48b102cb-64c5-4120-b1ef-50fefcbf2b1e roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
7942024-11-09T01:30:39.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 48b102cb-64c5-4120-b1ef-50fefcbf2b1e resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
7952024-11-09T01:30:39.974ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5187e22-c26e-4207-a89d-7566b1b26eba", "content-length": "682", "date": "Sat, 09 Nov 2024 01:30:39 GMT"} })
7962024-11-09T01:30:39.974ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7972024-11-09T01:30:39.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7982024-11-09T01:30:39.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 48b102cb-64c5-4120-b1ef-50fefcbf2b1e response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
7992024-11-09T01:30:39.978ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8002024-11-09T01:30:39.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8012024-11-09T01:30:39.982ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8022024-11-09T01:30:39.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8032024-11-09T01:30:39.985ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8042024-11-09T01:30:39.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8052024-11-09T01:30:39.992ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 907.957753ms iteration = 17 status = {}
8062024-11-09T01:30:40.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = ffa1eaeb-779c-4a7f-b0be-4f390a5b08ff roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
8072024-11-09T01:30:40.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = ffa1eaeb-779c-4a7f-b0be-4f390a5b08ff resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
8082024-11-09T01:30:40.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = ffa1eaeb-779c-4a7f-b0be-4f390a5b08ff response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
8092024-11-09T01:30:40.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a009150d-8821-4986-9545-ca103e7aae50 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8102024-11-09T01:30:40.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a009150d-8821-4986-9545-ca103e7aae50 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8112024-11-09T01:30:41.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a009150d-8821-4986-9545-ca103e7aae50 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8122024-11-09T01:30:42.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2281e328-3355-4c3b-96d1-a6ea99c20e86 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8132024-11-09T01:30:42.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2281e328-3355-4c3b-96d1-a6ea99c20e86 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8142024-11-09T01:30:42.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2281e328-3355-4c3b-96d1-a6ea99c20e86 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8152024-11-09T01:30:43.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d877da34-1f0f-47bc-aaea-24e0c816fee5 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8162024-11-09T01:30:43.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d877da34-1f0f-47bc-aaea-24e0c816fee5 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8172024-11-09T01:30:43.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d877da34-1f0f-47bc-aaea-24e0c816fee5 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8182024-11-09T01:30:44.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = af037dbb-bac4-41c6-9a3d-21d65c71efa4 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8192024-11-09T01:30:44.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = af037dbb-bac4-41c6-9a3d-21d65c71efa4 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8202024-11-09T01:30:44.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2418 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = af037dbb-bac4-41c6-9a3d-21d65c71efa4 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8212024-11-09T01:30:44.971ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1289 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = ce904bf1-e95a-488a-802a-5f21dae14b29 response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
8222024-11-09T01:30:45.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 48a393ea-146b-4264-af1c-70821171f049 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8232024-11-09T01:30:45.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 48a393ea-146b-4264-af1c-70821171f049 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8242024-11-09T01:30:45.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 48a393ea-146b-4264-af1c-70821171f049 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8252024-11-09T01:30:46.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d5c86d12-4bc9-4f5f-bab7-1fc72fc494b0 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8262024-11-09T01:30:46.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d5c86d12-4bc9-4f5f-bab7-1fc72fc494b0 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8272024-11-09T01:30:46.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2095 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d5c86d12-4bc9-4f5f-bab7-1fc72fc494b0 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8282024-11-09T01:30:47.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a25c4f78-45a3-4248-bd47-bbf5abed528d roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8292024-11-09T01:30:47.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a25c4f78-45a3-4248-bd47-bbf5abed528d resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8302024-11-09T01:30:47.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a25c4f78-45a3-4248-bd47-bbf5abed528d response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8312024-11-09T01:30:48.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 91590f2c-747f-43fb-92d6-261504dbd3a0 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8322024-11-09T01:30:48.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 91590f2c-747f-43fb-92d6-261504dbd3a0 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8332024-11-09T01:30:48.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 91590f2c-747f-43fb-92d6-261504dbd3a0 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8342024-11-09T01:30:49.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
8352024-11-09T01:30:49.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
8362024-11-09T01:30:49.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8372024-11-09T01:30:49.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8382024-11-09T01:30:49.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8392024-11-09T01:30:49.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8402024-11-09T01:30:49.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8412024-11-09T01:30:49.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8422024-11-09T01:30:49.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8432024-11-09T01:30:49.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.184176ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8442024-11-09T01:30:49.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8452024-11-09T01:30:49.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8462024-11-09T01:30:49.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8472024-11-09T01:30:49.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8482024-11-09T01:30:49.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8492024-11-09T01:30:49.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8502024-11-09T01:30:49.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
8512024-11-09T01:30:49.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8522024-11-09T01:30:49.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8532024-11-09T01:30:49.104ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
8542024-11-09T01:30:49.104ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.864801ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
8552024-11-09T01:30:49.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c1a19414-e84b-4a3a-b7dd-55d447529147 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8562024-11-09T01:30:49.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c1a19414-e84b-4a3a-b7dd-55d447529147 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8572024-11-09T01:30:49.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1882 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c1a19414-e84b-4a3a-b7dd-55d447529147 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8582024-11-09T01:30:50.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = fc4fbf05-1dca-45fe-abde-28e5d1f2cd10 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8592024-11-09T01:30:50.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = fc4fbf05-1dca-45fe-abde-28e5d1f2cd10 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8602024-11-09T01:30:50.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = fc4fbf05-1dca-45fe-abde-28e5d1f2cd10 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8612024-11-09T01:30:51.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4964865f-5cb1-453a-a966-b3e7bdffacba roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8622024-11-09T01:30:51.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4964865f-5cb1-453a-a966-b3e7bdffacba resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8632024-11-09T01:30:51.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1824 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4964865f-5cb1-453a-a966-b3e7bdffacba response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8642024-11-09T01:30:52.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 44d8c9d8-d85a-4c0d-8f26-62abeb0973f6 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8652024-11-09T01:30:52.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 44d8c9d8-d85a-4c0d-8f26-62abeb0973f6 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8662024-11-09T01:30:52.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2421 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 44d8c9d8-d85a-4c0d-8f26-62abeb0973f6 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8672024-11-09T01:30:53.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 06444fda-4967-4fc9-b1f2-e4786adfbf9b roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8682024-11-09T01:30:53.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 06444fda-4967-4fc9-b1f2-e4786adfbf9b resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8692024-11-09T01:30:53.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2552 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 06444fda-4967-4fc9-b1f2-e4786adfbf9b response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8702024-11-09T01:30:54.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4ed4b12c-cb1c-4729-81ec-fa4345c1f529 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8712024-11-09T01:30:54.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4ed4b12c-cb1c-4729-81ec-fa4345c1f529 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8722024-11-09T01:30:54.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4ed4b12c-cb1c-4729-81ec-fa4345c1f529 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8732024-11-09T01:30:55.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 18f42850-9b44-4d39-9c60-3c9e8224f208 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8742024-11-09T01:30:55.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 18f42850-9b44-4d39-9c60-3c9e8224f208 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8752024-11-09T01:30:55.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 18f42850-9b44-4d39-9c60-3c9e8224f208 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8762024-11-09T01:30:56.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9d186a6c-9719-4274-a010-8be6ddb38739 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8772024-11-09T01:30:56.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9d186a6c-9719-4274-a010-8be6ddb38739 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8782024-11-09T01:30:56.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1865 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9d186a6c-9719-4274-a010-8be6ddb38739 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8792024-11-09T01:30:57.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b9c2ad02-06f0-4623-a2d5-5cd1e8972166 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8802024-11-09T01:30:57.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b9c2ad02-06f0-4623-a2d5-5cd1e8972166 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8812024-11-09T01:30:57.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2608 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b9c2ad02-06f0-4623-a2d5-5cd1e8972166 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8822024-11-09T01:30:58.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5a0ed092-95de-4566-8010-76a726ede33d roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8832024-11-09T01:30:58.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5a0ed092-95de-4566-8010-76a726ede33d resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8842024-11-09T01:30:58.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2005 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5a0ed092-95de-4566-8010-76a726ede33d response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
8852024-11-09T01:30:59.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
8862024-11-09T01:30:59.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8872024-11-09T01:30:59.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
8882024-11-09T01:30:59.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8892024-11-09T01:30:59.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8902024-11-09T01:30:59.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8912024-11-09T01:30:59.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8922024-11-09T01:30:59.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8932024-11-09T01:30:59.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8942024-11-09T01:30:59.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.184055ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8952024-11-09T01:30:59.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8962024-11-09T01:30:59.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8972024-11-09T01:30:59.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8982024-11-09T01:30:59.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8992024-11-09T01:30:59.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9002024-11-09T01:30:59.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9012024-11-09T01:30:59.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
9022024-11-09T01:30:59.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9032024-11-09T01:30:59.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9042024-11-09T01:30:59.106ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
9052024-11-09T01:30:59.106ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.297948ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
9062024-11-09T01:30:59.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bc14c369-a013-4762-b679-6c983308748c roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9072024-11-09T01:30:59.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bc14c369-a013-4762-b679-6c983308748c resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9082024-11-09T01:30:59.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bc14c369-a013-4762-b679-6c983308748c response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9092024-11-09T01:30:59.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1716 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = 96ce163a-205f-4229-979c-10049a59d446 response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
9102024-11-09T01:31:00.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a0a9242c-3941-4afa-a1f3-a612ce7e1c0f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9112024-11-09T01:31:00.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a0a9242c-3941-4afa-a1f3-a612ce7e1c0f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9122024-11-09T01:31:00.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2036 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a0a9242c-3941-4afa-a1f3-a612ce7e1c0f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9132024-11-09T01:31:01.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9069b8ad-b776-4c26-b35a-245db873ae85 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9142024-11-09T01:31:01.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9069b8ad-b776-4c26-b35a-245db873ae85 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9152024-11-09T01:31:01.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2464 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9069b8ad-b776-4c26-b35a-245db873ae85 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9162024-11-09T01:31:02.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = aac8b292-7dfa-4cc3-91b3-e3e948c7cae8 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9172024-11-09T01:31:02.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = aac8b292-7dfa-4cc3-91b3-e3e948c7cae8 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9182024-11-09T01:31:02.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = aac8b292-7dfa-4cc3-91b3-e3e948c7cae8 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9192024-11-09T01:31:03.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = cacdb94c-d3d1-4ce5-ac5c-8b01c1b823dc roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9202024-11-09T01:31:03.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = cacdb94c-d3d1-4ce5-ac5c-8b01c1b823dc resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9212024-11-09T01:31:03.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = cacdb94c-d3d1-4ce5-ac5c-8b01c1b823dc response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9222024-11-09T01:31:04.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d0ba3287-e59a-4216-9b90-2347cf24512e roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9232024-11-09T01:31:04.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d0ba3287-e59a-4216-9b90-2347cf24512e resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9242024-11-09T01:31:04.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d0ba3287-e59a-4216-9b90-2347cf24512e response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9252024-11-09T01:31:05.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f125a854-8705-470c-9174-bbebfb8694e5 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9262024-11-09T01:31:05.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f125a854-8705-470c-9174-bbebfb8694e5 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9272024-11-09T01:31:05.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f125a854-8705-470c-9174-bbebfb8694e5 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9282024-11-09T01:31:06.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7b638857-2730-4aff-91f9-937b0479e3b6 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9292024-11-09T01:31:06.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7b638857-2730-4aff-91f9-937b0479e3b6 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9302024-11-09T01:31:06.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7b638857-2730-4aff-91f9-937b0479e3b6 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9312024-11-09T01:31:07.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e0cdf9e9-88d1-4cb6-bf37-4c100d774fc3 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9322024-11-09T01:31:07.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e0cdf9e9-88d1-4cb6-bf37-4c100d774fc3 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9332024-11-09T01:31:07.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e0cdf9e9-88d1-4cb6-bf37-4c100d774fc3 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9342024-11-09T01:31:08.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 42c84b0b-0208-4feb-929a-a459d944ba4c roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9352024-11-09T01:31:08.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 42c84b0b-0208-4feb-929a-a459d944ba4c resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9362024-11-09T01:31:08.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 42c84b0b-0208-4feb-929a-a459d944ba4c response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
9372024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
9382024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9392024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
9402024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9412024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
9422024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9432024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
9442024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9452024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
9462024-11-09T01:31:09.085ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
9472024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9482024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
9492024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9502024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
9512024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
9522024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9532024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9542024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
9552024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
9562024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9572024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
9582024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9592024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9602024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
9612024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9622024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
9632024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9642024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
9652024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.769\u{b5}s iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
9662024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
9672024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
9682024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.55\u{b5}s iteration = 18 status = {"errors":[],"records_set_to_done":[]}
9692024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.18\u{b5}s iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
9702024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
9712024-11-09T01:31:09.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.58\u{b5}s iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
9722024-11-09T01:31:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9732024-11-09T01:31:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9742024-11-09T01:31:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9752024-11-09T01:31:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9762024-11-09T01:31:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9772024-11-09T01:31:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9782024-11-09T01:31:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
9792024-11-09T01:31:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9802024-11-09T01:31:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9812024-11-09T01:31:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9822024-11-09T01:31:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9832024-11-09T01:31:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9842024-11-09T01:31:09.088ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9852024-11-09T01:31:09.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9862024-11-09T01:31:09.089ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9872024-11-09T01:31:09.089ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.051605ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
9882024-11-09T01:31:09.090ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9892024-11-09T01:31:09.090ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
9902024-11-09T01:31:09.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9912024-11-09T01:31:09.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9922024-11-09T01:31:09.090ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1186, tv_nsec: 111986322 } })
9932024-11-09T01:31:09.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9942024-11-09T01:31:09.090ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
9952024-11-09T01:31:09.091ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9962024-11-09T01:31:09.091ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1186, tv_nsec: 112979393 } })
9972024-11-09T01:31:09.091ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
9982024-11-09T01:31:09.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
9992024-11-09T01:31:09.091ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10002024-11-09T01:31:09.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10012024-11-09T01:31:09.092ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10022024-11-09T01:31:09.092ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10032024-11-09T01:31:09.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10042024-11-09T01:31:09.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10052024-11-09T01:31:09.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10062024-11-09T01:31:09.093ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10072024-11-09T01:31:09.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10082024-11-09T01:31:09.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10092024-11-09T01:31:09.095ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10102024-11-09T01:31:09.095ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 9.665578ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10112024-11-09T01:31:09.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10122024-11-09T01:31:09.095ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10132024-11-09T01:31:09.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10142024-11-09T01:31:09.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10152024-11-09T01:31:09.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10162024-11-09T01:31:09.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10172024-11-09T01:31:09.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10182024-11-09T01:31:09.097ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10192024-11-09T01:31:09.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10202024-11-09T01:31:09.098ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10212024-11-09T01:31:09.098ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
10222024-11-09T01:31:09.098ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10232024-11-09T01:31:09.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10242024-11-09T01:31:09.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10252024-11-09T01:31:09.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10262024-11-09T01:31:09.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10272024-11-09T01:31:09.100ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10282024-11-09T01:31:09.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10292024-11-09T01:31:09.100ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1186, tv_nsec: 121853062 } })
10302024-11-09T01:31:09.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10312024-11-09T01:31:09.100ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
10322024-11-09T01:31:09.103ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10332024-11-09T01:31:09.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10342024-11-09T01:31:09.105ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10352024-11-09T01:31:09.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10362024-11-09T01:31:09.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10372024-11-09T01:31:09.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
10382024-11-09T01:31:09.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10392024-11-09T01:31:09.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10402024-11-09T01:31:09.123ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
10412024-11-09T01:31:09.123ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 37.983984ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
10422024-11-09T01:31:09.133ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10432024-11-09T01:31:09.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10442024-11-09T01:31:09.134ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10452024-11-09T01:31:09.134ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10462024-11-09T01:31:09.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10472024-11-09T01:31:09.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10482024-11-09T01:31:09.136ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10492024-11-09T01:31:09.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10502024-11-09T01:31:09.141ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10512024-11-09T01:31:09.141ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
10522024-11-09T01:31:09.141ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 55.872983ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
10532024-11-09T01:31:09.142ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10542024-11-09T01:31:09.142ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.675032ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
10552024-11-09T01:31:09.143ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10562024-11-09T01:31:09.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10572024-11-09T01:31:09.145ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10582024-11-09T01:31:09.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10592024-11-09T01:31:09.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 75.294139ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10602024-11-09T01:31:09.164ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
10612024-11-09T01:31:09.164ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10622024-11-09T01:31:09.164ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "808c5714-6d70-42c8-af83-2be918362b19", "content-length": "26", "date": "Sat, 09 Nov 2024 01:31:09 GMT"} })
10632024-11-09T01:31:09.164ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10642024-11-09T01:31:09.166ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10652024-11-09T01:31:09.166ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10662024-11-09T01:31:09.169ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
10672024-11-09T01:31:09.169ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10682024-11-09T01:31:09.169ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "806741d1-ebe2-46da-8835-c4f7fd669f17", "content-length": "26", "date": "Sat, 09 Nov 2024 01:31:09 GMT"} })
10692024-11-09T01:31:09.169ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10702024-11-09T01:31:09.169ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c24f6fb-cc5e-4758-a216-4357bbb5d813, lookup_type: ById(8c24f6fb-cc5e-4758-a216-4357bbb5d813) } result = Ok(())
10712024-11-09T01:31:09.169ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10722024-11-09T01:31:09.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10732024-11-09T01:31:09.171ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10742024-11-09T01:31:09.171ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 86.070609ms iteration = 18 status = 0
10752024-11-09T01:31:09.188ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba zone_address = fd00:1122:3344:101::2
10762024-11-09T01:31:09.188ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10772024-11-09T01:31:09.188ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0db5dddb-05f7-4f2c-a17b-66d0199b88fe", "content-length": "26", "date": "Sat, 09 Nov 2024 01:31:09 GMT"} })
10782024-11-09T01:31:09.188ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10792024-11-09T01:31:09.190ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
10802024-11-09T01:31:09.217ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10812024-11-09T01:31:09.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10822024-11-09T01:31:09.239ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 154.033277ms iteration = 21 status = {"physical_disks_added":0}
10832024-11-09T01:31:09.253ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
10842024-11-09T01:31:09.253ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "00982670-7a68-4f14-bc5c-a31fa69a2030", "content-length": "1", "date": "Sat, 09 Nov 2024 01:31:08 GMT"} })
10852024-11-09T01:31:09.255ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10862024-11-09T01:31:09.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10872024-11-09T01:31:09.268ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
10882024-11-09T01:31:09.268ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10892024-11-09T01:31:09.268ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "667ced0d-a191-4cec-94ee-4285aa24bd92", "content-length": "372", "date": "Sat, 09 Nov 2024 01:31:09 GMT"} })
10902024-11-09T01:31:09.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10912024-11-09T01:31:09.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10922024-11-09T01:31:09.269ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10932024-11-09T01:31:09.270ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 185.092574ms iteration = 18 status = null
10942024-11-09T01:31:09.270ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 185.505589ms iteration = 18 status = {}
10952024-11-09T01:31:09.271ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10962024-11-09T01:31:09.271ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10972024-11-09T01:31:09.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10982024-11-09T01:31:09.272ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10992024-11-09T01:31:09.274ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11002024-11-09T01:31:09.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11012024-11-09T01:31:09.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11022024-11-09T01:31:09.310ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
11032024-11-09T01:31:09.310ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
11042024-11-09T01:31:09.310ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "da5d631f-1611-4847-bb03-846d1a14ab0a", "date": "Sat, 09 Nov 2024 01:31:09 GMT"} })
11052024-11-09T01:31:09.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11062024-11-09T01:31:09.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11072024-11-09T01:31:09.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11082024-11-09T01:31:09.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11092024-11-09T01:31:09.314ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11102024-11-09T01:31:09.314ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0f5bbd3-c33c-46b8-9cbf-d392c07d0574", "content-length": "691", "date": "Sat, 09 Nov 2024 01:31:09 GMT"} })
11112024-11-09T01:31:09.314ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
11122024-11-09T01:31:09.314ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
11132024-11-09T01:31:09.314ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
11142024-11-09T01:31:09.316ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11152024-11-09T01:31:09.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11162024-11-09T01:31:09.316ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 231.314219ms iteration = 18 status = {}
11172024-11-09T01:31:09.319ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
11182024-11-09T01:31:09.319ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11192024-11-09T01:31:09.320ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "213eec6c-9d2f-4aba-815f-56eb6245a54b", "date": "Sat, 09 Nov 2024 01:31:09 GMT"} })
11202024-11-09T01:31:09.321ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 236.177854ms iteration = 19 status = {}
11212024-11-09T01:31:09.341ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11222024-11-09T01:31:09.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11232024-11-09T01:31:09.343ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 68cb9c64-43d4-4c3f-ba7b-013513b8c68d, rack_id: 54080907-d4a8-4f65-b867-da4e2da6d2ba, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8166ae85-b9fa-427c-9f22-e997378e0527) } rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
11242024-11-09T01:31:09.343ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11252024-11-09T01:31:09.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11262024-11-09T01:31:09.352ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
11272024-11-09T01:31:09.352ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "aad466c9-2ff9-40e3-a9d0-394ef194fa37", "content-length": "134", "date": "Sat, 09 Nov 2024 01:31:08 GMT"} })
11282024-11-09T01:31:09.352ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
11292024-11-09T01:31:09.352ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8166ae85-b9fa-427c-9f22-e997378e0527
11302024-11-09T01:31:09.353ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
11312024-11-09T01:31:09.353ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11322024-11-09T01:31:09.353ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11332024-11-09T01:31:09.353ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11342024-11-09T01:31:09.353ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11352024-11-09T01:31:09.353ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11362024-11-09T01:31:09.353ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11372024-11-09T01:31:09.353ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11382024-11-09T01:31:09.353ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
11392024-11-09T01:31:09.353ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11402024-11-09T01:31:09.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11412024-11-09T01:31:09.355ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
11422024-11-09T01:31:09.355ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b114fbb0-59a1-4453-8a46-2392554b5f6a", "content-length": "2", "date": "Sat, 09 Nov 2024 01:31:08 GMT"} })
11432024-11-09T01:31:09.355ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
11442024-11-09T01:31:09.355ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f040a570-aac6-4429-84d7-1bd014267d3c", "content-length": "52", "date": "Sat, 09 Nov 2024 01:31:08 GMT"} })
11452024-11-09T01:31:09.355ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
11462024-11-09T01:31:09.355ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
11472024-11-09T01:31:09.459ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "19553736-3611-4d6a-8f31-4e28ebe7cbfb", "date": "Sat, 09 Nov 2024 01:31:09 GMT"} })
11482024-11-09T01:31:09.459ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch = Switch0
11492024-11-09T01:31:09.459ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
11502024-11-09T01:31:09.459ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "29f055f5-195e-48b5-bc4c-3a71c8f8b2df", "content-length": "682", "date": "Sat, 09 Nov 2024 01:31:09 GMT"} })
11512024-11-09T01:31:09.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11522024-11-09T01:31:09.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11532024-11-09T01:31:09.463ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11542024-11-09T01:31:09.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11552024-11-09T01:31:09.466ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11562024-11-09T01:31:09.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11572024-11-09T01:31:09.468ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11582024-11-09T01:31:09.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11592024-11-09T01:31:09.475ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 390.10431ms iteration = 18 status = {}
11602024-11-09T01:31:09.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8ef6c53d-e119-4f59-b4c7-8ffbe0611116 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11612024-11-09T01:31:09.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8ef6c53d-e119-4f59-b4c7-8ffbe0611116 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11622024-11-09T01:31:09.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4583 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8ef6c53d-e119-4f59-b4c7-8ffbe0611116 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11632024-11-09T01:31:10.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 3e68ce55-1cfa-4bb5-b572-b7a01f5b4d1e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
11642024-11-09T01:31:10.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 3e68ce55-1cfa-4bb5-b572-b7a01f5b4d1e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
11652024-11-09T01:31:10.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 3e68ce55-1cfa-4bb5-b572-b7a01f5b4d1e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
11662024-11-09T01:31:10.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 83773623-6872-46ae-9951-95cb389322c1 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11672024-11-09T01:31:10.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 83773623-6872-46ae-9951-95cb389322c1 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11682024-11-09T01:31:10.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 83773623-6872-46ae-9951-95cb389322c1 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11692024-11-09T01:31:11.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8264e513-be01-4f0b-b802-c3d1bd9115c0 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11702024-11-09T01:31:11.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8264e513-be01-4f0b-b802-c3d1bd9115c0 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11712024-11-09T01:31:11.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8264e513-be01-4f0b-b802-c3d1bd9115c0 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11722024-11-09T01:31:12.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = fb131377-94a8-44e1-95f2-d88374525733 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11732024-11-09T01:31:12.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = fb131377-94a8-44e1-95f2-d88374525733 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11742024-11-09T01:31:12.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = fb131377-94a8-44e1-95f2-d88374525733 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11752024-11-09T01:31:13.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 70298231-981b-44a9-bea9-c0bb6e9eca66 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11762024-11-09T01:31:13.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 70298231-981b-44a9-bea9-c0bb6e9eca66 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11772024-11-09T01:31:13.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2075 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 70298231-981b-44a9-bea9-c0bb6e9eca66 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11782024-11-09T01:31:14.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9632c646-5db4-4cdc-8219-f9632698b35f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11792024-11-09T01:31:14.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9632c646-5db4-4cdc-8219-f9632698b35f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11802024-11-09T01:31:14.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2476 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9632c646-5db4-4cdc-8219-f9632698b35f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11812024-11-09T01:31:14.972ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1419 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = fef5f7be-33f4-4591-86f0-cb7fd46f5e77 response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
11822024-11-09T01:31:15.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 17e0c6f7-13c9-4e0c-a2bf-555fabd3e8b7 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11832024-11-09T01:31:15.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 17e0c6f7-13c9-4e0c-a2bf-555fabd3e8b7 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11842024-11-09T01:31:15.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 17e0c6f7-13c9-4e0c-a2bf-555fabd3e8b7 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11852024-11-09T01:31:16.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5de48473-d4de-4dad-9127-75d5913493e3 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11862024-11-09T01:31:16.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5de48473-d4de-4dad-9127-75d5913493e3 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11872024-11-09T01:31:16.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2185 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5de48473-d4de-4dad-9127-75d5913493e3 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11882024-11-09T01:31:17.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bd30ea20-0a7f-46da-9283-7b1591b94a0a roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11892024-11-09T01:31:17.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bd30ea20-0a7f-46da-9283-7b1591b94a0a resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11902024-11-09T01:31:17.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1965 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bd30ea20-0a7f-46da-9283-7b1591b94a0a response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11912024-11-09T01:31:18.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 88198f6f-a184-4fee-8914-c3d47ecd5157 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11922024-11-09T01:31:18.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 88198f6f-a184-4fee-8914-c3d47ecd5157 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11932024-11-09T01:31:18.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 88198f6f-a184-4fee-8914-c3d47ecd5157 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
11942024-11-09T01:31:19.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
11952024-11-09T01:31:19.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11962024-11-09T01:31:19.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
11972024-11-09T01:31:19.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11982024-11-09T01:31:19.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11992024-11-09T01:31:19.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12002024-11-09T01:31:19.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12012024-11-09T01:31:19.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12022024-11-09T01:31:19.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12032024-11-09T01:31:19.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.677161ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12042024-11-09T01:31:19.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12052024-11-09T01:31:19.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12062024-11-09T01:31:19.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12072024-11-09T01:31:19.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12082024-11-09T01:31:19.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12092024-11-09T01:31:19.127ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12102024-11-09T01:31:19.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
12112024-11-09T01:31:19.130ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12122024-11-09T01:31:19.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12132024-11-09T01:31:19.142ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
12142024-11-09T01:31:19.142ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.867916ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
12152024-11-09T01:31:19.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 547a3cd7-3424-481c-a69c-736368a662c9 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12162024-11-09T01:31:19.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 547a3cd7-3424-481c-a69c-736368a662c9 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12172024-11-09T01:31:19.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1832 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 547a3cd7-3424-481c-a69c-736368a662c9 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12182024-11-09T01:31:19.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 606d3b1e-b964-40e5-8a5f-d9fd521d1973 roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
12192024-11-09T01:31:19.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 606d3b1e-b964-40e5-8a5f-d9fd521d1973 resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
12202024-11-09T01:31:19.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2855 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 606d3b1e-b964-40e5-8a5f-d9fd521d1973 response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
12212024-11-09T01:31:19.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = d930da26-b015-4fc4-862e-5a846c9bcdab roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
12222024-11-09T01:31:19.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = d930da26-b015-4fc4-862e-5a846c9bcdab resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
12232024-11-09T01:31:19.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = d930da26-b015-4fc4-862e-5a846c9bcdab response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
12242024-11-09T01:31:20.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 1195d34b-01d7-4a74-aebb-376bb585b3e7 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12252024-11-09T01:31:20.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 1195d34b-01d7-4a74-aebb-376bb585b3e7 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12262024-11-09T01:31:20.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2305 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 1195d34b-01d7-4a74-aebb-376bb585b3e7 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12272024-11-09T01:31:21.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 52c328e4-0ec5-4a49-a9f2-8c2569f69489 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12282024-11-09T01:31:21.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 52c328e4-0ec5-4a49-a9f2-8c2569f69489 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12292024-11-09T01:31:21.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2391 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 52c328e4-0ec5-4a49-a9f2-8c2569f69489 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12302024-11-09T01:31:22.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5586e9c2-d7c1-4bd6-bffb-b83330739524 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12312024-11-09T01:31:22.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5586e9c2-d7c1-4bd6-bffb-b83330739524 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12322024-11-09T01:31:22.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2533 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5586e9c2-d7c1-4bd6-bffb-b83330739524 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12332024-11-09T01:31:23.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5ee7e725-db66-4924-b3c3-eafce4d63d98 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12342024-11-09T01:31:23.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5ee7e725-db66-4924-b3c3-eafce4d63d98 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12352024-11-09T01:31:23.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5ee7e725-db66-4924-b3c3-eafce4d63d98 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12362024-11-09T01:31:24.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 27e67fec-13e0-4bba-9dda-eaa7b94a9024 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12372024-11-09T01:31:24.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 27e67fec-13e0-4bba-9dda-eaa7b94a9024 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12382024-11-09T01:31:24.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 27e67fec-13e0-4bba-9dda-eaa7b94a9024 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12392024-11-09T01:31:26.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ea135495-5c23-4787-a4f7-60023bf36c4f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12402024-11-09T01:31:26.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ea135495-5c23-4787-a4f7-60023bf36c4f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12412024-11-09T01:31:26.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ea135495-5c23-4787-a4f7-60023bf36c4f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12422024-11-09T01:31:27.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4e9ba21d-9725-4eda-a78b-39a74c31c797 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12432024-11-09T01:31:27.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4e9ba21d-9725-4eda-a78b-39a74c31c797 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12442024-11-09T01:31:27.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4e9ba21d-9725-4eda-a78b-39a74c31c797 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12452024-11-09T01:31:28.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5b3a65e8-9f9a-45e2-9167-2fe3b63cc436 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12462024-11-09T01:31:28.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5b3a65e8-9f9a-45e2-9167-2fe3b63cc436 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12472024-11-09T01:31:28.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5b3a65e8-9f9a-45e2-9167-2fe3b63cc436 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12482024-11-09T01:31:29.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
12492024-11-09T01:31:29.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12502024-11-09T01:31:29.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
12512024-11-09T01:31:29.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12522024-11-09T01:31:29.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12532024-11-09T01:31:29.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12542024-11-09T01:31:29.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 776614fd-445b-467a-9f92-5814867c5ebd roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12552024-11-09T01:31:29.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 776614fd-445b-467a-9f92-5814867c5ebd resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12562024-11-09T01:31:29.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12572024-11-09T01:31:29.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12582024-11-09T01:31:29.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12592024-11-09T01:31:29.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1802 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 776614fd-445b-467a-9f92-5814867c5ebd response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12602024-11-09T01:31:29.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.940664ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12612024-11-09T01:31:29.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12622024-11-09T01:31:29.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12632024-11-09T01:31:29.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12642024-11-09T01:31:29.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12652024-11-09T01:31:29.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12662024-11-09T01:31:29.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12672024-11-09T01:31:29.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
12682024-11-09T01:31:29.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12692024-11-09T01:31:29.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12702024-11-09T01:31:29.106ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
12712024-11-09T01:31:29.106ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.840692ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
12722024-11-09T01:31:29.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1384 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = f27e8687-194d-4f09-8052-8fdd83719468 response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
12732024-11-09T01:31:30.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8ea4e6b8-810b-49eb-9ce0-1d08d927b0ec roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12742024-11-09T01:31:30.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8ea4e6b8-810b-49eb-9ce0-1d08d927b0ec resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12752024-11-09T01:31:30.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2038 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8ea4e6b8-810b-49eb-9ce0-1d08d927b0ec response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12762024-11-09T01:31:31.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d481c232-87c3-4ef8-8281-a084dcc60a46 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12772024-11-09T01:31:31.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d481c232-87c3-4ef8-8281-a084dcc60a46 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12782024-11-09T01:31:31.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d481c232-87c3-4ef8-8281-a084dcc60a46 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12792024-11-09T01:31:32.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 333866bc-213f-4250-ac87-510affc483ba roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12802024-11-09T01:31:32.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 333866bc-213f-4250-ac87-510affc483ba resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12812024-11-09T01:31:32.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 333866bc-213f-4250-ac87-510affc483ba response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12822024-11-09T01:31:33.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 93c3502c-8433-491f-93c8-991c6d4b0542 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12832024-11-09T01:31:33.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 93c3502c-8433-491f-93c8-991c6d4b0542 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12842024-11-09T01:31:33.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1854 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 93c3502c-8433-491f-93c8-991c6d4b0542 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12852024-11-09T01:31:34.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ac36dada-cbb0-420a-bb0f-8e9d7e56e827 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12862024-11-09T01:31:34.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ac36dada-cbb0-420a-bb0f-8e9d7e56e827 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12872024-11-09T01:31:34.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2351 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ac36dada-cbb0-420a-bb0f-8e9d7e56e827 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12882024-11-09T01:31:35.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f1513a14-8230-4144-b685-3d80b97d2aba roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12892024-11-09T01:31:35.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f1513a14-8230-4144-b685-3d80b97d2aba resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12902024-11-09T01:31:35.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f1513a14-8230-4144-b685-3d80b97d2aba response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12912024-11-09T01:31:36.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 1cde6d62-ba23-4141-9271-ae094cd342be roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12922024-11-09T01:31:36.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 1cde6d62-ba23-4141-9271-ae094cd342be resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12932024-11-09T01:31:36.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 1cde6d62-ba23-4141-9271-ae094cd342be response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12942024-11-09T01:31:37.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 509045d4-81fb-4e12-9fcd-5e6e6aae63aa roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12952024-11-09T01:31:37.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 509045d4-81fb-4e12-9fcd-5e6e6aae63aa resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12962024-11-09T01:31:37.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2548 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 509045d4-81fb-4e12-9fcd-5e6e6aae63aa response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12972024-11-09T01:31:38.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7d3bc837-dba1-4d0b-b125-4d9cb4c59950 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12982024-11-09T01:31:38.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7d3bc837-dba1-4d0b-b125-4d9cb4c59950 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
12992024-11-09T01:31:38.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2002 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7d3bc837-dba1-4d0b-b125-4d9cb4c59950 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
13002024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
13012024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13022024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
13032024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
13042024-11-09T01:31:39.085ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13052024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13062024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
13072024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
13082024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13092024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
13102024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
13112024-11-09T01:31:39.085ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 01:21:39.085386408 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
13122024-11-09T01:31:39.085ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079
13132024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
13142024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
13152024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.621\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079"}
13162024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
13172024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
13182024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
13192024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13202024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
13212024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
13222024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
13232024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13242024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13252024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
13262024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13272024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13282024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
13292024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
13302024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
13312024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
13322024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13332024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13342024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
13352024-11-09T01:31:39.085ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
13362024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
13372024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
13382024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
13392024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13402024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
13412024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
13422024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13432024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13442024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
13452024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13462024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
13472024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13482024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
13492024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13502024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
13512024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13522024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
13532024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13542024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
13552024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 11.25\u{b5}s iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
13562024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
13572024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
13582024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
13592024-11-09T01:31:39.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.98\u{b5}s iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
13602024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.06\u{b5}s iteration = 19 status = {"errors":[],"records_set_to_done":[]}
13612024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
13622024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
13632024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.34\u{b5}s iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
13642024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
13652024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13662024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13672024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13682024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13692024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13702024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
13712024-11-09T01:31:39.086ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("30d356ab-a881-4ca3-8f43-203be0381a68.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d55caa1f-cc37-4ecb-b8bf-58b9052db1d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d55caa1f-cc37-4ecb-b8bf-58b9052db1d9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1216, tv_nsec: 107160388 } })
13722024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13732024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
13742024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
13752024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13762024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13772024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13782024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13792024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13802024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13812024-11-09T01:31:39.086ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("34219892-cef8-4169-a366-ce17844120f6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("530f76d0-bec9-4ae0-beb0-d217f68ae05a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("530f76d0-bec9-4ae0-beb0-d217f68ae05a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1216, tv_nsec: 107386750 } })
13822024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
13832024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13842024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13852024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13862024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13872024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13882024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13892024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
13902024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13912024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13922024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
13932024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.274085ms iteration = 11 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
13942024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13952024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13962024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
13972024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.249904ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
13982024-11-09T01:31:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13992024-11-09T01:31:39.087ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14002024-11-09T01:31:39.088ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14012024-11-09T01:31:39.088ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14022024-11-09T01:31:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14032024-11-09T01:31:39.089ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14042024-11-09T01:31:39.089ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.405549ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14052024-11-09T01:31:39.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14062024-11-09T01:31:39.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14072024-11-09T01:31:39.090ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 01:21:39.085386408 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
14082024-11-09T01:31:39.090ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.101247ms iteration = 10 status = {"expiration":"2024-11-09T01:21:39.085386408Z","pruned":[]}
14092024-11-09T01:31:39.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14102024-11-09T01:31:39.091ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14112024-11-09T01:31:39.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14122024-11-09T01:31:39.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14132024-11-09T01:31:39.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14142024-11-09T01:31:39.091ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14152024-11-09T01:31:39.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14162024-11-09T01:31:39.093ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14172024-11-09T01:31:39.093ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14182024-11-09T01:31:39.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14192024-11-09T01:31:39.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
14202024-11-09T01:31:39.095ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14212024-11-09T01:31:39.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14222024-11-09T01:31:39.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14232024-11-09T01:31:39.098ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1216, tv_nsec: 119174172 } })
14242024-11-09T01:31:39.098ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
14252024-11-09T01:31:39.098ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1216, tv_nsec: 120021751 } })
14262024-11-09T01:31:39.099ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
14272024-11-09T01:31:39.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14282024-11-09T01:31:39.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14292024-11-09T01:31:39.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14302024-11-09T01:31:39.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14312024-11-09T01:31:39.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14322024-11-09T01:31:39.103ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.88623ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
14332024-11-09T01:31:39.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14342024-11-09T01:31:39.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14352024-11-09T01:31:39.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14362024-11-09T01:31:39.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14372024-11-09T01:31:39.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14382024-11-09T01:31:39.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14392024-11-09T01:31:39.108ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14402024-11-09T01:31:39.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14412024-11-09T01:31:39.110ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14422024-11-09T01:31:39.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14432024-11-09T01:31:39.111ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14442024-11-09T01:31:39.111ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14452024-11-09T01:31:39.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14462024-11-09T01:31:39.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14472024-11-09T01:31:39.118ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14482024-11-09T01:31:39.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14492024-11-09T01:31:39.120ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14502024-11-09T01:31:39.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14512024-11-09T01:31:39.121ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1216, tv_nsec: 142675494 } })
14522024-11-09T01:31:39.121ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
14532024-11-09T01:31:39.127ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14542024-11-09T01:31:39.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14552024-11-09T01:31:39.132ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14562024-11-09T01:31:39.132ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14572024-11-09T01:31:39.132ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14582024-11-09T01:31:39.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14592024-11-09T01:31:39.134ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
14602024-11-09T01:31:39.134ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
14612024-11-09T01:31:39.134ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 48.614172ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
14622024-11-09T01:31:39.134ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 49.685664ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14632024-11-09T01:31:39.135ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14642024-11-09T01:31:39.137ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14652024-11-09T01:31:39.137ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14662024-11-09T01:31:39.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14672024-11-09T01:31:39.138ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14682024-11-09T01:31:39.138ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14692024-11-09T01:31:39.138ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14702024-11-09T01:31:39.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14712024-11-09T01:31:39.139ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14722024-11-09T01:31:39.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14732024-11-09T01:31:39.140ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14742024-11-09T01:31:39.141ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14752024-11-09T01:31:39.141ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14762024-11-09T01:31:39.144ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14772024-11-09T01:31:39.144ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14782024-11-09T01:31:39.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14792024-11-09T01:31:39.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
14802024-11-09T01:31:39.145ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14812024-11-09T01:31:39.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14822024-11-09T01:31:39.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14832024-11-09T01:31:39.145ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14842024-11-09T01:31:39.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14852024-11-09T01:31:39.145ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14862024-11-09T01:31:39.148ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14872024-11-09T01:31:39.148ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14882024-11-09T01:31:39.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14892024-11-09T01:31:39.149ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14902024-11-09T01:31:39.151ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14912024-11-09T01:31:39.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14922024-11-09T01:31:39.151ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14932024-11-09T01:31:39.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14942024-11-09T01:31:39.152ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14952024-11-09T01:31:39.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14962024-11-09T01:31:39.152ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14972024-11-09T01:31:39.152ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.719484ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
14982024-11-09T01:31:39.154ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14992024-11-09T01:31:39.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15002024-11-09T01:31:39.154ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15012024-11-09T01:31:39.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15022024-11-09T01:31:39.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15032024-11-09T01:31:39.155ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15042024-11-09T01:31:39.158ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15052024-11-09T01:31:39.158ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
15062024-11-09T01:31:39.158ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15072024-11-09T01:31:39.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15082024-11-09T01:31:39.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15092024-11-09T01:31:39.165ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
15102024-11-09T01:31:39.165ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
15112024-11-09T01:31:39.165ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 79.529637ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
15122024-11-09T01:31:39.165ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
15132024-11-09T01:31:39.165ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
15142024-11-09T01:31:39.165ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
15152024-11-09T01:31:39.165ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15162024-11-09T01:31:39.166ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15172024-11-09T01:31:39.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15182024-11-09T01:31:39.167ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15192024-11-09T01:31:39.167ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15202024-11-09T01:31:39.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15212024-11-09T01:31:39.176ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15222024-11-09T01:31:39.176ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15232024-11-09T01:31:39.176ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15242024-11-09T01:31:39.176ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 90.540869ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
15252024-11-09T01:31:39.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15262024-11-09T01:31:39.177ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15272024-11-09T01:31:39.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15282024-11-09T01:31:39.182ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
15292024-11-09T01:31:39.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15302024-11-09T01:31:39.189ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
15312024-11-09T01:31:39.189ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
15322024-11-09T01:31:39.189ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
15332024-11-09T01:31:39.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15342024-11-09T01:31:39.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15352024-11-09T01:31:39.199ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
15362024-11-09T01:31:39.204ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
15372024-11-09T01:31:39.213ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
15382024-11-09T01:31:39.213ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15392024-11-09T01:31:39.214ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "45214571-8394-4f2d-92a6-d412889b18b0", "content-length": "26", "date": "Sat, 09 Nov 2024 01:31:39 GMT"} })
15402024-11-09T01:31:39.214ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15412024-11-09T01:31:39.216ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15422024-11-09T01:31:39.259ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
15432024-11-09T01:31:39.259ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15442024-11-09T01:31:39.259ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c65df1c8-8628-48f4-a7be-060637ad76b7", "content-length": "26", "date": "Sat, 09 Nov 2024 01:31:39 GMT"} })
15452024-11-09T01:31:39.259ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15462024-11-09T01:31:39.261ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15472024-11-09T01:31:39.265ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba zone_address = fd00:1122:3344:101::2
15482024-11-09T01:31:39.265ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15492024-11-09T01:31:39.265ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "31859c95-4276-44a2-82fb-09da6af68ebe", "content-length": "26", "date": "Sat, 09 Nov 2024 01:31:39 GMT"} })
15502024-11-09T01:31:39.265ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15512024-11-09T01:31:39.266ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
15522024-11-09T01:31:39.313ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
15532024-11-09T01:31:39.313ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15542024-11-09T01:31:39.313ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "af53a30a-e0fa-421e-8aed-cdde6691cbc1", "content-length": "372", "date": "Sat, 09 Nov 2024 01:31:39 GMT"} })
15552024-11-09T01:31:39.313ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15562024-11-09T01:31:39.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15572024-11-09T01:31:39.315ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 230.194727ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15582024-11-09T01:31:39.316ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15592024-11-09T01:31:39.316ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 230.762823ms iteration = 5 status = {"nsuccess":5}
15602024-11-09T01:31:39.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15612024-11-09T01:31:39.316ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15622024-11-09T01:31:39.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15632024-11-09T01:31:39.319ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15642024-11-09T01:31:39.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15652024-11-09T01:31:39.321ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
15662024-11-09T01:31:39.321ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 236.188733ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
15672024-11-09T01:31:39.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15682024-11-09T01:31:39.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4efa08ed-7545-4638-9d89-741ba2736c2c roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
15692024-11-09T01:31:39.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4efa08ed-7545-4638-9d89-741ba2736c2c resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
15702024-11-09T01:31:39.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4efa08ed-7545-4638-9d89-741ba2736c2c response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
15712024-11-09T01:31:39.328ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15722024-11-09T01:31:39.328ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15732024-11-09T01:31:39.328ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15742024-11-09T01:31:39.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15752024-11-09T01:31:39.331ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c24f6fb-cc5e-4758-a216-4357bbb5d813, lookup_type: ById(8c24f6fb-cc5e-4758-a216-4357bbb5d813) } result = Ok(())
15762024-11-09T01:31:39.331ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15772024-11-09T01:31:39.331ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
15782024-11-09T01:31:39.331ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 245.70483ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
15792024-11-09T01:31:39.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15802024-11-09T01:31:39.333ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 247.917384ms iteration = 19 status = 0
15812024-11-09T01:31:39.354ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15822024-11-09T01:31:39.358ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 272.983034ms iteration = 22 status = {"physical_disks_added":0}
15832024-11-09T01:31:39.359ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15842024-11-09T01:31:39.359ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15852024-11-09T01:31:39.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15862024-11-09T01:31:39.362ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
15872024-11-09T01:31:39.362ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = dadc16e6-e16c-4c3f-bb19-4f189e9d1c26 dns_zone_name = oxide.test found_so_far = 0 version = 2
15882024-11-09T01:31:39.362ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15892024-11-09T01:31:39.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15902024-11-09T01:31:39.363ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15912024-11-09T01:31:39.364ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
15922024-11-09T01:31:39.364ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 72269a3a-73dc-4fb3-8a06-f7b406523664 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
15932024-11-09T01:31:39.364ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15942024-11-09T01:31:39.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15952024-11-09T01:31:39.366ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15962024-11-09T01:31:39.366ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15972024-11-09T01:31:39.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15982024-11-09T01:31:39.367ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15992024-11-09T01:31:39.369ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = dadc16e6-e16c-4c3f-bb19-4f189e9d1c26 dns_zone_name = oxide.test found_so_far = 1 version = 2
16002024-11-09T01:31:39.369ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
16012024-11-09T01:31:39.369ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 01:23:03.974860 UTC dns_group = external generation = 2
16022024-11-09T01:31:39.369ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 283.641163ms iteration = 11 status = {"generation":2}
16032024-11-09T01:31:39.370ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16042024-11-09T01:31:39.370ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16052024-11-09T01:31:39.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16062024-11-09T01:31:39.373ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 72269a3a-73dc-4fb3-8a06-f7b406523664 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
16072024-11-09T01:31:39.373ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
16082024-11-09T01:31:39.373ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 01:23:03.098267 UTC dns_group = internal generation = 1
16092024-11-09T01:31:39.373ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 288.174483ms iteration = 11 status = {"generation":1}
16102024-11-09T01:31:39.377ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
16112024-11-09T01:31:39.377ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16122024-11-09T01:31:39.377ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d144fc03-f597-40e5-b56a-7776535ccd2f", "date": "Sat, 09 Nov 2024 01:31:39 GMT"} })
16132024-11-09T01:31:39.377ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16142024-11-09T01:31:39.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16152024-11-09T01:31:39.378ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
16162024-11-09T01:31:39.379ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
16172024-11-09T01:31:39.380ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "00b54847-f0fb-43c4-8ced-1526333e62ac", "date": "Sat, 09 Nov 2024 01:31:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16182024-11-09T01:31:39.380ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16192024-11-09T01:31:39.380ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16202024-11-09T01:31:39.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16212024-11-09T01:31:39.382ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c1f3a8bc-c88a-4cce-95cf-b9905247dc6d", "date": "Sat, 09 Nov 2024 01:31:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16222024-11-09T01:31:39.382ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16232024-11-09T01:31:39.383ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16242024-11-09T01:31:39.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16252024-11-09T01:31:39.385ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16262024-11-09T01:31:39.385ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 299.684472ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
16272024-11-09T01:31:39.387ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16282024-11-09T01:31:39.387ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16292024-11-09T01:31:39.388ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f80d75b0-d267-4867-a162-2d6fa74912c1", "date": "Sat, 09 Nov 2024 01:31:39 GMT"} })
16302024-11-09T01:31:39.389ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 303.483955ms iteration = 19 status = {}
16312024-11-09T01:31:39.390ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 304.993701ms iteration = 20 status = {}
16322024-11-09T01:31:39.401ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T01:22:35.233443Z, time_modified: 2024-11-09T01:22:35.233443Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 539ccef2-8207-42b1-9e05-00e0a1387c35, db_silo: Silo { identity: SiloIdentity { id: 539ccef2-8207-42b1-9e05-00e0a1387c35, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T01:23:03.926223Z, time_modified: 2024-11-09T01:23:03.926223Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 539ccef2-8207-42b1-9e05-00e0a1387c35, db_silo: Silo { identity: SiloIdentity { id: 539ccef2-8207-42b1-9e05-00e0a1387c35, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T01:23:03.926223Z, time_modified: 2024-11-09T01:23:03.926223Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248" }] }) }
16332024-11-09T01:31:39.401ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 316.230266ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"539ccef2-8207-42b1-9e05-00e0a1387c35","tls_certs":["22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248"]}},"default_endpoint":{"silo_id":"539ccef2-8207-42b1-9e05-00e0a1387c35","tls_certs":["22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
16342024-11-09T01:31:39.419ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16352024-11-09T01:31:39.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16362024-11-09T01:31:39.421ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16372024-11-09T01:31:39.423ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16382024-11-09T01:31:39.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16392024-11-09T01:31:39.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16402024-11-09T01:31:39.451ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16412024-11-09T01:31:39.453ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16422024-11-09T01:31:39.453ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16432024-11-09T01:31:39.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16442024-11-09T01:31:39.463ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16452024-11-09T01:31:39.464ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9069010-bd1e-4693-b678-7c532a2ae879", "content-length": "1", "date": "Sat, 09 Nov 2024 01:31:39 GMT"} })
16462024-11-09T01:31:39.465ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16472024-11-09T01:31:39.466ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
16482024-11-09T01:31:39.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16492024-11-09T01:31:39.466ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9b26866f-3cea-4834-a835-4b4a6a28dc2e", "date": "Sat, 09 Nov 2024 01:31:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
16502024-11-09T01:31:39.466ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
16512024-11-09T01:31:39.468ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "34669307-e2a3-441b-8da4-a76a8bdec3c8", "date": "Sat, 09 Nov 2024 01:31:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
16522024-11-09T01:31:39.468ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
16532024-11-09T01:31:39.471ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "0d0c443e-9c65-433d-8151-626a59bd7d04", "date": "Sat, 09 Nov 2024 01:31:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
16542024-11-09T01:31:39.471ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
16552024-11-09T01:31:39.471ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 385.69705ms iteration = 19 status = null
16562024-11-09T01:31:39.473ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
16572024-11-09T01:31:39.473ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 387.851264ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
16582024-11-09T01:31:39.562ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16592024-11-09T01:31:39.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16602024-11-09T01:31:39.564ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 68cb9c64-43d4-4c3f-ba7b-013513b8c68d, rack_id: 54080907-d4a8-4f65-b867-da4e2da6d2ba, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8166ae85-b9fa-427c-9f22-e997378e0527) } rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
16612024-11-09T01:31:39.564ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16622024-11-09T01:31:39.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16632024-11-09T01:31:39.577ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16642024-11-09T01:31:39.578ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a28c5ef-6529-491a-afe3-d3d21f61bce4", "content-length": "691", "date": "Sat, 09 Nov 2024 01:31:39 GMT"} })
16652024-11-09T01:31:39.578ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
16662024-11-09T01:31:39.578ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
16672024-11-09T01:31:39.578ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
16682024-11-09T01:31:39.580ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 494.895288ms iteration = 19 status = {}
16692024-11-09T01:31:39.599ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16702024-11-09T01:31:39.599ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc860077-4b07-4c93-a4bd-8e802a0a4503", "content-length": "134", "date": "Sat, 09 Nov 2024 01:31:39 GMT"} })
16712024-11-09T01:31:39.599ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
16722024-11-09T01:31:39.599ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8166ae85-b9fa-427c-9f22-e997378e0527
16732024-11-09T01:31:39.599ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
16742024-11-09T01:31:39.599ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16752024-11-09T01:31:39.599ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16762024-11-09T01:31:39.599ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16772024-11-09T01:31:39.599ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16782024-11-09T01:31:39.599ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16792024-11-09T01:31:39.600ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16802024-11-09T01:31:39.600ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16812024-11-09T01:31:39.600ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
16822024-11-09T01:31:39.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16832024-11-09T01:31:39.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16842024-11-09T01:31:39.601ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
16852024-11-09T01:31:39.601ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "be39b865-6260-4428-acaa-a54e5443aba0", "content-length": "2", "date": "Sat, 09 Nov 2024 01:31:39 GMT"} })
16862024-11-09T01:31:39.601ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16872024-11-09T01:31:39.602ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "da08125f-f997-4b21-9b3f-f4b031a38f26", "content-length": "52", "date": "Sat, 09 Nov 2024 01:31:39 GMT"} })
16882024-11-09T01:31:39.602ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
16892024-11-09T01:31:39.602ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16902024-11-09T01:31:39.732ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "865587af-224a-4300-af96-a3d5c4fcdaa7", "date": "Sat, 09 Nov 2024 01:31:39 GMT"} })
16912024-11-09T01:31:39.732ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch = Switch0
16922024-11-09T01:31:39.732ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16932024-11-09T01:31:39.733ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c5a43b7-3c58-46da-8e4d-9b01baa1e405", "content-length": "682", "date": "Sat, 09 Nov 2024 01:31:39 GMT"} })
16942024-11-09T01:31:39.733ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16952024-11-09T01:31:39.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16962024-11-09T01:31:39.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16972024-11-09T01:31:39.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16982024-11-09T01:31:39.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16992024-11-09T01:31:39.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17002024-11-09T01:31:39.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17012024-11-09T01:31:39.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17022024-11-09T01:31:39.749ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 663.816692ms iteration = 19 status = {}
17032024-11-09T01:31:40.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = fdeb31ff-e6d0-41d2-8bf4-772e1f036024 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
17042024-11-09T01:31:40.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = fdeb31ff-e6d0-41d2-8bf4-772e1f036024 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
17052024-11-09T01:31:40.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = fdeb31ff-e6d0-41d2-8bf4-772e1f036024 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
17062024-11-09T01:31:40.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 657fa1ab-1167-4ac1-b2f9-25b6994fbdee roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17072024-11-09T01:31:40.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 657fa1ab-1167-4ac1-b2f9-25b6994fbdee resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17082024-11-09T01:31:40.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 657fa1ab-1167-4ac1-b2f9-25b6994fbdee response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17092024-11-09T01:31:41.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ec0ed1bf-b5ef-47e1-8fe8-a89ed8eb25c1 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17102024-11-09T01:31:41.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ec0ed1bf-b5ef-47e1-8fe8-a89ed8eb25c1 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17112024-11-09T01:31:41.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2938 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ec0ed1bf-b5ef-47e1-8fe8-a89ed8eb25c1 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17122024-11-09T01:31:42.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a256d10b-4936-4eb1-8f62-b0feb5c7c343 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17132024-11-09T01:31:42.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a256d10b-4936-4eb1-8f62-b0feb5c7c343 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17142024-11-09T01:31:42.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2549 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a256d10b-4936-4eb1-8f62-b0feb5c7c343 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17152024-11-09T01:31:43.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7a248216-831c-48e2-a681-4709be5a8e97 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17162024-11-09T01:31:43.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7a248216-831c-48e2-a681-4709be5a8e97 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17172024-11-09T01:31:43.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7a248216-831c-48e2-a681-4709be5a8e97 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17182024-11-09T01:31:44.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b9068ff4-d795-4a2a-a0db-cfcf06a508cf roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17192024-11-09T01:31:44.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b9068ff4-d795-4a2a-a0db-cfcf06a508cf resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17202024-11-09T01:31:44.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b9068ff4-d795-4a2a-a0db-cfcf06a508cf response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17212024-11-09T01:31:44.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1386 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = 34b26904-95c6-40ec-b6ad-01d186825508 response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
17222024-11-09T01:31:45.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 179429f5-81a7-4e7c-8bf7-aca865d3860f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17232024-11-09T01:31:45.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 179429f5-81a7-4e7c-8bf7-aca865d3860f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17242024-11-09T01:31:45.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2628 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 179429f5-81a7-4e7c-8bf7-aca865d3860f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17252024-11-09T01:31:46.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = cc503d16-7cb2-4de3-928c-5ce582636901 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17262024-11-09T01:31:46.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = cc503d16-7cb2-4de3-928c-5ce582636901 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17272024-11-09T01:31:46.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = cc503d16-7cb2-4de3-928c-5ce582636901 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17282024-11-09T01:31:47.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 49d40e12-837b-49bf-80a8-ef8367f90999 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17292024-11-09T01:31:47.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 49d40e12-837b-49bf-80a8-ef8367f90999 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17302024-11-09T01:31:47.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2990 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 49d40e12-837b-49bf-80a8-ef8367f90999 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17312024-11-09T01:31:48.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 50c02e4a-2754-46ae-94c0-2f3412f69d5b roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17322024-11-09T01:31:48.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 50c02e4a-2754-46ae-94c0-2f3412f69d5b resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17332024-11-09T01:31:48.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 50c02e4a-2754-46ae-94c0-2f3412f69d5b response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17342024-11-09T01:31:49.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
17352024-11-09T01:31:49.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17362024-11-09T01:31:49.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
17372024-11-09T01:31:49.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17382024-11-09T01:31:49.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17392024-11-09T01:31:49.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17402024-11-09T01:31:49.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17412024-11-09T01:31:49.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17422024-11-09T01:31:49.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17432024-11-09T01:31:49.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17442024-11-09T01:31:49.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17452024-11-09T01:31:49.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17462024-11-09T01:31:49.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17472024-11-09T01:31:49.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
17482024-11-09T01:31:49.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17492024-11-09T01:31:49.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17502024-11-09T01:31:49.108ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
17512024-11-09T01:31:49.108ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.735583ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
17522024-11-09T01:31:49.113ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17532024-11-09T01:31:49.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17542024-11-09T01:31:49.141ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.017575ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17552024-11-09T01:31:49.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d8f04e74-2fe1-444f-95e4-219630e02682 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17562024-11-09T01:31:49.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d8f04e74-2fe1-444f-95e4-219630e02682 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17572024-11-09T01:31:49.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1853 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d8f04e74-2fe1-444f-95e4-219630e02682 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17582024-11-09T01:31:50.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d8b110e7-2017-40bb-9542-e7e8c9bebb09 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17592024-11-09T01:31:50.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d8b110e7-2017-40bb-9542-e7e8c9bebb09 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17602024-11-09T01:31:50.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d8b110e7-2017-40bb-9542-e7e8c9bebb09 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17612024-11-09T01:31:51.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a7845df1-a16b-4bea-87ca-b80cbac17db5 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17622024-11-09T01:31:51.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a7845df1-a16b-4bea-87ca-b80cbac17db5 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17632024-11-09T01:31:51.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2467 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a7845df1-a16b-4bea-87ca-b80cbac17db5 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17642024-11-09T01:31:52.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 373fef19-9054-4e0e-8f38-fecd1c28f362 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17652024-11-09T01:31:52.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 373fef19-9054-4e0e-8f38-fecd1c28f362 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17662024-11-09T01:31:52.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1914 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 373fef19-9054-4e0e-8f38-fecd1c28f362 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17672024-11-09T01:31:53.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4bfcef86-fecc-4ea9-a01d-e93967cdd57e roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17682024-11-09T01:31:53.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4bfcef86-fecc-4ea9-a01d-e93967cdd57e resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17692024-11-09T01:31:53.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2683 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4bfcef86-fecc-4ea9-a01d-e93967cdd57e response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17702024-11-09T01:31:54.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 657f61f6-bd8a-433a-92c8-c2e2560b0b3f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17712024-11-09T01:31:54.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 657f61f6-bd8a-433a-92c8-c2e2560b0b3f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17722024-11-09T01:31:54.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 657f61f6-bd8a-433a-92c8-c2e2560b0b3f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17732024-11-09T01:31:55.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 10572946-bda5-4f23-a324-bb61601f87de roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17742024-11-09T01:31:55.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 10572946-bda5-4f23-a324-bb61601f87de resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17752024-11-09T01:31:55.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 10572946-bda5-4f23-a324-bb61601f87de response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17762024-11-09T01:31:56.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f1d3cc44-5353-4e1e-b869-699b6991b936 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17772024-11-09T01:31:56.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f1d3cc44-5353-4e1e-b869-699b6991b936 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17782024-11-09T01:31:56.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1911 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f1d3cc44-5353-4e1e-b869-699b6991b936 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17792024-11-09T01:31:57.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7de216d5-3e3d-4a73-8a7b-1321f91702e1 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17802024-11-09T01:31:57.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7de216d5-3e3d-4a73-8a7b-1321f91702e1 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17812024-11-09T01:31:57.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2467 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7de216d5-3e3d-4a73-8a7b-1321f91702e1 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17822024-11-09T01:31:58.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c2600c35-3d50-44ad-acb4-1d25ce16742b roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17832024-11-09T01:31:58.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c2600c35-3d50-44ad-acb4-1d25ce16742b resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17842024-11-09T01:31:58.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2808 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c2600c35-3d50-44ad-acb4-1d25ce16742b response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
17852024-11-09T01:31:59.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
17862024-11-09T01:31:59.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17872024-11-09T01:31:59.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
17882024-11-09T01:31:59.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17892024-11-09T01:31:59.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17902024-11-09T01:31:59.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17912024-11-09T01:31:59.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17922024-11-09T01:31:59.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17932024-11-09T01:31:59.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17942024-11-09T01:31:59.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17952024-11-09T01:31:59.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17962024-11-09T01:31:59.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17972024-11-09T01:31:59.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17982024-11-09T01:31:59.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17992024-11-09T01:31:59.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18002024-11-09T01:31:59.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
18012024-11-09T01:31:59.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18022024-11-09T01:31:59.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18032024-11-09T01:31:59.106ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
18042024-11-09T01:31:59.106ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.389079ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
18052024-11-09T01:31:59.116ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.095797ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18062024-11-09T01:31:59.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = abce10b2-fbe8-4892-b859-4fdd33c6038b roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18072024-11-09T01:31:59.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = abce10b2-fbe8-4892-b859-4fdd33c6038b resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18082024-11-09T01:31:59.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1710 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = abce10b2-fbe8-4892-b859-4fdd33c6038b response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18092024-11-09T01:31:59.970ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2128 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = 024fb014-876b-48d6-84b4-057cdde895c6 response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
18102024-11-09T01:32:00.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 08f858f1-94ab-4120-8c2e-21eb18b3cf8f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18112024-11-09T01:32:00.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 08f858f1-94ab-4120-8c2e-21eb18b3cf8f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18122024-11-09T01:32:00.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1818 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 08f858f1-94ab-4120-8c2e-21eb18b3cf8f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18132024-11-09T01:32:01.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d82d1eaf-5992-4562-aa9e-24f59b89041c roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18142024-11-09T01:32:01.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d82d1eaf-5992-4562-aa9e-24f59b89041c resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18152024-11-09T01:32:01.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2592 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d82d1eaf-5992-4562-aa9e-24f59b89041c response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18162024-11-09T01:32:02.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 32e73e8b-288d-42ac-ad71-496dfaacc314 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18172024-11-09T01:32:02.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 32e73e8b-288d-42ac-ad71-496dfaacc314 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18182024-11-09T01:32:02.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 32e73e8b-288d-42ac-ad71-496dfaacc314 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18192024-11-09T01:32:03.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3314dc24-b66a-455e-ad45-38aa3bb12ea6 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18202024-11-09T01:32:03.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3314dc24-b66a-455e-ad45-38aa3bb12ea6 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18212024-11-09T01:32:03.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1997 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3314dc24-b66a-455e-ad45-38aa3bb12ea6 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18222024-11-09T01:32:04.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b8c4a28a-721b-47dc-af09-c6662e5fb85c roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18232024-11-09T01:32:04.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b8c4a28a-721b-47dc-af09-c6662e5fb85c resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18242024-11-09T01:32:04.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2430 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b8c4a28a-721b-47dc-af09-c6662e5fb85c response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18252024-11-09T01:32:05.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bd3c6886-5bd0-4ae2-907b-0a8b0a441c02 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18262024-11-09T01:32:05.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bd3c6886-5bd0-4ae2-907b-0a8b0a441c02 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18272024-11-09T01:32:05.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bd3c6886-5bd0-4ae2-907b-0a8b0a441c02 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18282024-11-09T01:32:07.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2a64d3bb-6db1-47f9-a5d8-976a89078f5e roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18292024-11-09T01:32:07.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2a64d3bb-6db1-47f9-a5d8-976a89078f5e resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18302024-11-09T01:32:07.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2a64d3bb-6db1-47f9-a5d8-976a89078f5e response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18312024-11-09T01:32:08.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6591dd46-0710-4d88-881b-da0f34aecdc3 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18322024-11-09T01:32:08.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6591dd46-0710-4d88-881b-da0f34aecdc3 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18332024-11-09T01:32:08.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6591dd46-0710-4d88-881b-da0f34aecdc3 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18342024-11-09T01:32:09.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a94e011c-08e4-425a-a387-dcd49164143a roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18352024-11-09T01:32:09.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a94e011c-08e4-425a-a387-dcd49164143a resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18362024-11-09T01:32:09.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a94e011c-08e4-425a-a387-dcd49164143a response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
18372024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
18382024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
18392024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18402024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18412024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
18422024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18432024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
18442024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18452024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
18462024-11-09T01:32:09.085ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18472024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18482024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18492024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
18502024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18512024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
18522024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18532024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
18542024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18552024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
18562024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
18572024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18582024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
18592024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18602024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18612024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
18622024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18632024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
18642024-11-09T01:32:09.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18652024-11-09T01:32:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18662024-11-09T01:32:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18672024-11-09T01:32:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18682024-11-09T01:32:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18692024-11-09T01:32:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18702024-11-09T01:32:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18712024-11-09T01:32:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18722024-11-09T01:32:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18732024-11-09T01:32:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18742024-11-09T01:32:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18752024-11-09T01:32:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18762024-11-09T01:32:09.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
18772024-11-09T01:32:09.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
18782024-11-09T01:32:09.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.89\u{b5}s iteration = 20 status = {"errors":[],"records_set_to_done":[]}
18792024-11-09T01:32:09.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
18802024-11-09T01:32:09.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.91\u{b5}s iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
18812024-11-09T01:32:09.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
18822024-11-09T01:32:09.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.22\u{b5}s iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
18832024-11-09T01:32:09.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 7.48\u{b5}s iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
18842024-11-09T01:32:09.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18852024-11-09T01:32:09.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18862024-11-09T01:32:09.088ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18872024-11-09T01:32:09.089ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.039975ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18882024-11-09T01:32:09.089ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1246, tv_nsec: 110809939 } })
18892024-11-09T01:32:09.090ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1246, tv_nsec: 110959170 } })
18902024-11-09T01:32:09.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18912024-11-09T01:32:09.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18922024-11-09T01:32:09.090ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
18932024-11-09T01:32:09.090ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
18942024-11-09T01:32:09.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18952024-11-09T01:32:09.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18962024-11-09T01:32:09.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18972024-11-09T01:32:09.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18982024-11-09T01:32:09.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18992024-11-09T01:32:09.096ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19002024-11-09T01:32:09.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19012024-11-09T01:32:09.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19022024-11-09T01:32:09.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19032024-11-09T01:32:09.122ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19042024-11-09T01:32:09.123ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19052024-11-09T01:32:09.123ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19062024-11-09T01:32:09.123ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.461069ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19072024-11-09T01:32:09.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19082024-11-09T01:32:09.125ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19092024-11-09T01:32:09.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19102024-11-09T01:32:09.125ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19112024-11-09T01:32:09.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19122024-11-09T01:32:09.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19132024-11-09T01:32:09.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19142024-11-09T01:32:09.127ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19152024-11-09T01:32:09.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19162024-11-09T01:32:09.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19172024-11-09T01:32:09.128ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19182024-11-09T01:32:09.128ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1246, tv_nsec: 149425929 } })
19192024-11-09T01:32:09.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19202024-11-09T01:32:09.128ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
19212024-11-09T01:32:09.128ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19222024-11-09T01:32:09.128ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19232024-11-09T01:32:09.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19242024-11-09T01:32:09.129ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
19252024-11-09T01:32:09.129ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19262024-11-09T01:32:09.130ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5672106b-6c88-4294-8c6a-feac6cc54296", "content-length": "26", "date": "Sat, 09 Nov 2024 01:32:09 GMT"} })
19272024-11-09T01:32:09.130ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19282024-11-09T01:32:09.130ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19292024-11-09T01:32:09.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19302024-11-09T01:32:09.130ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19312024-11-09T01:32:09.131ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19322024-11-09T01:32:09.132ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
19332024-11-09T01:32:09.132ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19342024-11-09T01:32:09.132ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19352024-11-09T01:32:09.132ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
19362024-11-09T01:32:09.132ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19372024-11-09T01:32:09.132ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aaddb9fa-0334-40e9-86b3-b6d828a59ece", "content-length": "26", "date": "Sat, 09 Nov 2024 01:32:09 GMT"} })
19382024-11-09T01:32:09.132ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19392024-11-09T01:32:09.132ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19402024-11-09T01:32:09.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19412024-11-09T01:32:09.132ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19422024-11-09T01:32:09.132ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19432024-11-09T01:32:09.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19442024-11-09T01:32:09.134ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19452024-11-09T01:32:09.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
19462024-11-09T01:32:09.137ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19472024-11-09T01:32:09.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19482024-11-09T01:32:09.154ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19492024-11-09T01:32:09.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19502024-11-09T01:32:09.155ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
19512024-11-09T01:32:09.155ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 69.757458ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
19522024-11-09T01:32:09.157ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19532024-11-09T01:32:09.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19542024-11-09T01:32:09.160ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19552024-11-09T01:32:09.162ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19562024-11-09T01:32:09.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19572024-11-09T01:32:09.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19582024-11-09T01:32:09.164ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19592024-11-09T01:32:09.164ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 78.86707ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19602024-11-09T01:32:09.166ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.436188ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19612024-11-09T01:32:09.170ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19622024-11-09T01:32:09.170ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19632024-11-09T01:32:09.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19642024-11-09T01:32:09.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19652024-11-09T01:32:09.189ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19662024-11-09T01:32:09.191ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c24f6fb-cc5e-4758-a216-4357bbb5d813, lookup_type: ById(8c24f6fb-cc5e-4758-a216-4357bbb5d813) } result = Ok(())
19672024-11-09T01:32:09.191ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19682024-11-09T01:32:09.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19692024-11-09T01:32:09.193ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 108.038345ms iteration = 20 status = 0
19702024-11-09T01:32:09.206ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19712024-11-09T01:32:09.206ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19722024-11-09T01:32:09.206ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 120.721496ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19732024-11-09T01:32:09.207ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19742024-11-09T01:32:09.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19752024-11-09T01:32:09.220ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba zone_address = fd00:1122:3344:101::2
19762024-11-09T01:32:09.221ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19772024-11-09T01:32:09.221ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce6dca4b-67b6-4649-ae17-63ce75efd87c", "content-length": "26", "date": "Sat, 09 Nov 2024 01:32:09 GMT"} })
19782024-11-09T01:32:09.221ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19792024-11-09T01:32:09.222ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
19802024-11-09T01:32:09.233ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 148.391085ms iteration = 20 status = {}
19812024-11-09T01:32:09.235ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19822024-11-09T01:32:09.235ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e41f74e4-9691-4d09-a218-d67b7f630976", "content-length": "1", "date": "Sat, 09 Nov 2024 01:32:08 GMT"} })
19832024-11-09T01:32:09.237ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19842024-11-09T01:32:09.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19852024-11-09T01:32:09.243ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 157.86387ms iteration = 23 status = {"physical_disks_added":0}
19862024-11-09T01:32:09.243ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 157.730829ms iteration = 20 status = null
19872024-11-09T01:32:09.291ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
19882024-11-09T01:32:09.291ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19892024-11-09T01:32:09.291ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f4e8dd5-6f48-4bac-89f9-779ede3055a4", "content-length": "372", "date": "Sat, 09 Nov 2024 01:32:09 GMT"} })
19902024-11-09T01:32:09.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19912024-11-09T01:32:09.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19922024-11-09T01:32:09.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19932024-11-09T01:32:09.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19942024-11-09T01:32:09.334ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
19952024-11-09T01:32:09.334ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
19962024-11-09T01:32:09.334ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "520e6065-68e3-49cd-ad1a-919b7ba18310", "date": "Sat, 09 Nov 2024 01:32:09 GMT"} })
19972024-11-09T01:32:09.334ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19982024-11-09T01:32:09.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19992024-11-09T01:32:09.335ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20002024-11-09T01:32:09.336ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20012024-11-09T01:32:09.337ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20022024-11-09T01:32:09.337ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20032024-11-09T01:32:09.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20042024-11-09T01:32:09.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20052024-11-09T01:32:09.340ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20062024-11-09T01:32:09.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20072024-11-09T01:32:09.343ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20082024-11-09T01:32:09.343ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20092024-11-09T01:32:09.343ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fed2e57d-b505-4c31-9933-b9f9871e67ba", "date": "Sat, 09 Nov 2024 01:32:09 GMT"} })
20102024-11-09T01:32:09.345ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 259.646505ms iteration = 21 status = {}
20112024-11-09T01:32:09.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20122024-11-09T01:32:09.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20132024-11-09T01:32:09.353ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 68cb9c64-43d4-4c3f-ba7b-013513b8c68d, rack_id: 54080907-d4a8-4f65-b867-da4e2da6d2ba, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8166ae85-b9fa-427c-9f22-e997378e0527) } rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
20142024-11-09T01:32:09.353ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20152024-11-09T01:32:09.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20162024-11-09T01:32:09.362ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
20172024-11-09T01:32:09.362ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce6dee5b-f6ed-4429-a063-56b3aa1f3f24", "content-length": "134", "date": "Sat, 09 Nov 2024 01:32:09 GMT"} })
20182024-11-09T01:32:09.362ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
20192024-11-09T01:32:09.363ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8166ae85-b9fa-427c-9f22-e997378e0527
20202024-11-09T01:32:09.363ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
20212024-11-09T01:32:09.363ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20222024-11-09T01:32:09.363ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20232024-11-09T01:32:09.363ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20242024-11-09T01:32:09.363ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20252024-11-09T01:32:09.363ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20262024-11-09T01:32:09.363ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20272024-11-09T01:32:09.363ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20282024-11-09T01:32:09.363ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
20292024-11-09T01:32:09.363ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20302024-11-09T01:32:09.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20312024-11-09T01:32:09.364ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20322024-11-09T01:32:09.365ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
20332024-11-09T01:32:09.365ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6638cb72-5492-4cac-94a8-bc651b4ef8b2", "content-length": "2", "date": "Sat, 09 Nov 2024 01:32:09 GMT"} })
20342024-11-09T01:32:09.365ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
20352024-11-09T01:32:09.366ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "452a8aa3-e151-4a73-b231-9cd4159309e5", "content-length": "52", "date": "Sat, 09 Nov 2024 01:32:09 GMT"} })
20362024-11-09T01:32:09.366ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
20372024-11-09T01:32:09.366ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20382024-11-09T01:32:09.366ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20392024-11-09T01:32:09.366ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20402024-11-09T01:32:09.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20412024-11-09T01:32:09.450ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20422024-11-09T01:32:09.473ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6d995ab4-66ee-4e49-bd0b-46fdde3d0056", "date": "Sat, 09 Nov 2024 01:32:09 GMT"} })
20432024-11-09T01:32:09.473ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch = Switch0
20442024-11-09T01:32:09.473ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20452024-11-09T01:32:09.474ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "389fca10-ce2e-4ba5-88c4-7bf51f200411", "content-length": "691", "date": "Sat, 09 Nov 2024 01:32:09 GMT"} })
20462024-11-09T01:32:09.474ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
20472024-11-09T01:32:09.474ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
20482024-11-09T01:32:09.474ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
20492024-11-09T01:32:09.474ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "81352104-f42b-4643-8042-00e3d0569f47", "content-length": "682", "date": "Sat, 09 Nov 2024 01:32:09 GMT"} })
20502024-11-09T01:32:09.474ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20512024-11-09T01:32:09.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20522024-11-09T01:32:09.475ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 389.621455ms iteration = 20 status = {}
20532024-11-09T01:32:09.478ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20542024-11-09T01:32:09.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20552024-11-09T01:32:09.482ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20562024-11-09T01:32:09.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20572024-11-09T01:32:09.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20582024-11-09T01:32:09.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20592024-11-09T01:32:09.491ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 406.31139ms iteration = 20 status = {}
20602024-11-09T01:32:10.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8728080f-291f-4060-8b61-f30d6a7d3f7f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20612024-11-09T01:32:10.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8728080f-291f-4060-8b61-f30d6a7d3f7f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20622024-11-09T01:32:10.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8728080f-291f-4060-8b61-f30d6a7d3f7f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20632024-11-09T01:32:10.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = a7a90cc7-c82a-448b-a983-de741e117e96 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
20642024-11-09T01:32:10.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = a7a90cc7-c82a-448b-a983-de741e117e96 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
20652024-11-09T01:32:10.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3671 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = a7a90cc7-c82a-448b-a983-de741e117e96 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
20662024-11-09T01:32:11.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4079ea6c-5c67-429e-acf9-786cf7649bd0 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20672024-11-09T01:32:11.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4079ea6c-5c67-429e-acf9-786cf7649bd0 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20682024-11-09T01:32:11.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4079ea6c-5c67-429e-acf9-786cf7649bd0 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20692024-11-09T01:32:12.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 669de6ef-082c-49ff-80b2-d81f76512066 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20702024-11-09T01:32:12.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 669de6ef-082c-49ff-80b2-d81f76512066 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20712024-11-09T01:32:12.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2935 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 669de6ef-082c-49ff-80b2-d81f76512066 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20722024-11-09T01:32:13.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e0bbc914-7f8c-4557-88a5-d93773a8a008 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20732024-11-09T01:32:13.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e0bbc914-7f8c-4557-88a5-d93773a8a008 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20742024-11-09T01:32:13.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2707 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e0bbc914-7f8c-4557-88a5-d93773a8a008 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20752024-11-09T01:32:14.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = cfb9c270-2165-40bf-bfce-6bd9bd0af907 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20762024-11-09T01:32:14.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = cfb9c270-2165-40bf-bfce-6bd9bd0af907 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20772024-11-09T01:32:14.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1908 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = cfb9c270-2165-40bf-bfce-6bd9bd0af907 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20782024-11-09T01:32:14.971ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1323 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = b19fa1a0-1634-48a0-a08a-3d3c4c194662 response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
20792024-11-09T01:32:15.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = fd9fccba-ccf6-410f-9ad8-1c4e2554e9b5 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20802024-11-09T01:32:15.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = fd9fccba-ccf6-410f-9ad8-1c4e2554e9b5 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20812024-11-09T01:32:15.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2715 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = fd9fccba-ccf6-410f-9ad8-1c4e2554e9b5 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20822024-11-09T01:32:16.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e4fc6179-44eb-411b-aea4-c01b85bd9b9d roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20832024-11-09T01:32:16.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e4fc6179-44eb-411b-aea4-c01b85bd9b9d resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20842024-11-09T01:32:16.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2823 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e4fc6179-44eb-411b-aea4-c01b85bd9b9d response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20852024-11-09T01:32:17.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9d883414-26a7-4291-8f73-016704477a17 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20862024-11-09T01:32:17.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9d883414-26a7-4291-8f73-016704477a17 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20872024-11-09T01:32:17.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9d883414-26a7-4291-8f73-016704477a17 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20882024-11-09T01:32:18.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7ed67dc0-268f-4087-b1e2-035b4875fc06 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20892024-11-09T01:32:18.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7ed67dc0-268f-4087-b1e2-035b4875fc06 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20902024-11-09T01:32:18.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4580 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7ed67dc0-268f-4087-b1e2-035b4875fc06 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
20912024-11-09T01:32:19.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
20922024-11-09T01:32:19.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20932024-11-09T01:32:19.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
20942024-11-09T01:32:19.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20952024-11-09T01:32:19.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20962024-11-09T01:32:19.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20972024-11-09T01:32:19.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20982024-11-09T01:32:19.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20992024-11-09T01:32:19.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21002024-11-09T01:32:19.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21012024-11-09T01:32:19.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21022024-11-09T01:32:19.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21032024-11-09T01:32:19.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21042024-11-09T01:32:19.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21052024-11-09T01:32:19.114ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.61671ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21062024-11-09T01:32:19.119ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21072024-11-09T01:32:19.122ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
21082024-11-09T01:32:19.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21092024-11-09T01:32:19.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21102024-11-09T01:32:19.134ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
21112024-11-09T01:32:19.134ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.887275ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
21122024-11-09T01:32:19.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bf560488-513e-46a8-b9a9-05e6493e28db roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21132024-11-09T01:32:19.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bf560488-513e-46a8-b9a9-05e6493e28db resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21142024-11-09T01:32:19.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2556 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bf560488-513e-46a8-b9a9-05e6493e28db response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21152024-11-09T01:32:20.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9895b10c-8ec3-4967-93de-597cc43818f2 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21162024-11-09T01:32:20.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9895b10c-8ec3-4967-93de-597cc43818f2 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21172024-11-09T01:32:20.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2265 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9895b10c-8ec3-4967-93de-597cc43818f2 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21182024-11-09T01:32:21.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 43cb3323-f37b-4dae-b515-a7a9e456e2e9 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21192024-11-09T01:32:21.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 43cb3323-f37b-4dae-b515-a7a9e456e2e9 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21202024-11-09T01:32:21.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 43cb3323-f37b-4dae-b515-a7a9e456e2e9 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21212024-11-09T01:32:22.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6c88aaa3-8e79-439e-ab46-3367965df1f3 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21222024-11-09T01:32:22.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6c88aaa3-8e79-439e-ab46-3367965df1f3 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21232024-11-09T01:32:22.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6c88aaa3-8e79-439e-ab46-3367965df1f3 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21242024-11-09T01:32:23.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d445fbcb-5c65-4982-ba26-220ca94d4991 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21252024-11-09T01:32:23.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d445fbcb-5c65-4982-ba26-220ca94d4991 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21262024-11-09T01:32:23.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d445fbcb-5c65-4982-ba26-220ca94d4991 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21272024-11-09T01:32:24.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7edfc8dd-7b41-48dd-bda5-b33bf11ac2cb roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21282024-11-09T01:32:24.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7edfc8dd-7b41-48dd-bda5-b33bf11ac2cb resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21292024-11-09T01:32:24.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7edfc8dd-7b41-48dd-bda5-b33bf11ac2cb response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21302024-11-09T01:32:25.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b0e3e078-01c1-4066-82b6-64c022bf028d roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21312024-11-09T01:32:25.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b0e3e078-01c1-4066-82b6-64c022bf028d resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21322024-11-09T01:32:25.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b0e3e078-01c1-4066-82b6-64c022bf028d response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21332024-11-09T01:32:26.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e8e98380-1142-4662-901b-24a9b9b02293 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21342024-11-09T01:32:26.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e8e98380-1142-4662-901b-24a9b9b02293 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21352024-11-09T01:32:26.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e8e98380-1142-4662-901b-24a9b9b02293 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21362024-11-09T01:32:27.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9a79e80d-acd9-4671-bf7e-ae07f5a1f09d roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21372024-11-09T01:32:27.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9a79e80d-acd9-4671-bf7e-ae07f5a1f09d resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21382024-11-09T01:32:27.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9a79e80d-acd9-4671-bf7e-ae07f5a1f09d response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21392024-11-09T01:32:28.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 23015c72-f2b6-4fcb-a268-33308b83eb1a roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21402024-11-09T01:32:28.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 23015c72-f2b6-4fcb-a268-33308b83eb1a resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21412024-11-09T01:32:28.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1659 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 23015c72-f2b6-4fcb-a268-33308b83eb1a response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21422024-11-09T01:32:29.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
21432024-11-09T01:32:29.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21442024-11-09T01:32:29.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
21452024-11-09T01:32:29.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21462024-11-09T01:32:29.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21472024-11-09T01:32:29.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21482024-11-09T01:32:29.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21492024-11-09T01:32:29.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21502024-11-09T01:32:29.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21512024-11-09T01:32:29.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21522024-11-09T01:32:29.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21532024-11-09T01:32:29.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21542024-11-09T01:32:29.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21552024-11-09T01:32:29.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
21562024-11-09T01:32:29.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21572024-11-09T01:32:29.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21582024-11-09T01:32:29.104ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
21592024-11-09T01:32:29.104ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.173194ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
21602024-11-09T01:32:29.113ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21612024-11-09T01:32:29.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21622024-11-09T01:32:29.140ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.209876ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21632024-11-09T01:32:29.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b3980642-d2dd-4b27-99c8-98fe25ea54ff roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21642024-11-09T01:32:29.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b3980642-d2dd-4b27-99c8-98fe25ea54ff resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21652024-11-09T01:32:29.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2071 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b3980642-d2dd-4b27-99c8-98fe25ea54ff response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21662024-11-09T01:32:29.970ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = 79e1a725-fea9-4f42-8b93-5f020afd30d4 response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
21672024-11-09T01:32:30.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4642c4ec-fb54-4981-adbf-60350ebf6d62 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21682024-11-09T01:32:30.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4642c4ec-fb54-4981-adbf-60350ebf6d62 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21692024-11-09T01:32:30.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2284 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4642c4ec-fb54-4981-adbf-60350ebf6d62 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21702024-11-09T01:32:31.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ce4f5468-00a2-4ecf-b767-17e057be2413 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21712024-11-09T01:32:31.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ce4f5468-00a2-4ecf-b767-17e057be2413 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21722024-11-09T01:32:31.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2683 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ce4f5468-00a2-4ecf-b767-17e057be2413 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21732024-11-09T01:32:32.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c4e2edc2-a7c7-4979-94d6-ef0dbfb0818f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21742024-11-09T01:32:32.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c4e2edc2-a7c7-4979-94d6-ef0dbfb0818f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21752024-11-09T01:32:32.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c4e2edc2-a7c7-4979-94d6-ef0dbfb0818f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21762024-11-09T01:32:33.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c7a293ba-dd1b-4e5e-84a6-bdbd8629dcc4 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21772024-11-09T01:32:33.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c7a293ba-dd1b-4e5e-84a6-bdbd8629dcc4 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21782024-11-09T01:32:33.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1969 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c7a293ba-dd1b-4e5e-84a6-bdbd8629dcc4 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21792024-11-09T01:32:34.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7497c398-6d6b-4988-8c91-960d0b4eb621 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21802024-11-09T01:32:34.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7497c398-6d6b-4988-8c91-960d0b4eb621 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21812024-11-09T01:32:34.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2569 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7497c398-6d6b-4988-8c91-960d0b4eb621 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21822024-11-09T01:32:34.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 187af740-31c6-470c-a9bc-e51525a230fd roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
21832024-11-09T01:32:34.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 187af740-31c6-470c-a9bc-e51525a230fd resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
21842024-11-09T01:32:34.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2720 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 187af740-31c6-470c-a9bc-e51525a230fd response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
21852024-11-09T01:32:34.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 01b8aa11-61b7-47ad-b208-1bed4b2213ed roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
21862024-11-09T01:32:34.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 01b8aa11-61b7-47ad-b208-1bed4b2213ed resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
21872024-11-09T01:32:34.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 01b8aa11-61b7-47ad-b208-1bed4b2213ed response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
21882024-11-09T01:32:35.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2be0ceff-111f-42b8-87f5-37c1d6fddc7e roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21892024-11-09T01:32:35.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2be0ceff-111f-42b8-87f5-37c1d6fddc7e resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21902024-11-09T01:32:35.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2be0ceff-111f-42b8-87f5-37c1d6fddc7e response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21912024-11-09T01:32:35.684ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:52850
21922024-11-09T01:32:35.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52850 req_id = b1f7470d-2bd1-43e6-895d-3fbead117519 roles = RoleSet { roles: {} } uri = /metrics/producers
21932024-11-09T01:32:35.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52850 req_id = b1f7470d-2bd1-43e6-895d-3fbead117519 resource = Database result = Ok(()) uri = /metrics/producers
21942024-11-09T01:32:35.721ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = 7482031d-4c61-41c0-af62-0f1c419521b3
21952024-11-09T01:32:35.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37072 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52850 req_id = b1f7470d-2bd1-43e6-895d-3fbead117519 response_code = 201 uri = /metrics/producers
21962024-11-09T01:32:36.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c228c0b7-d0c8-44c6-8915-51339e95424f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21972024-11-09T01:32:36.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c228c0b7-d0c8-44c6-8915-51339e95424f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21982024-11-09T01:32:36.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1833 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c228c0b7-d0c8-44c6-8915-51339e95424f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
21992024-11-09T01:32:37.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b6b884c3-6868-45f0-8220-8511013d62e9 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
22002024-11-09T01:32:37.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b6b884c3-6868-45f0-8220-8511013d62e9 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
22012024-11-09T01:32:37.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b6b884c3-6868-45f0-8220-8511013d62e9 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
22022024-11-09T01:32:38.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bf48b8d3-7eb4-4d40-83ca-892b21ef4f54 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
22032024-11-09T01:32:38.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bf48b8d3-7eb4-4d40-83ca-892b21ef4f54 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
22042024-11-09T01:32:38.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2301 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bf48b8d3-7eb4-4d40-83ca-892b21ef4f54 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
22052024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
22062024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22072024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
22082024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22092024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
22102024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
22112024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
22122024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
22132024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22142024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
22152024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22162024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22172024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22182024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
22192024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
22202024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22212024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22222024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
22232024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
22242024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
22252024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
22262024-11-09T01:32:39.085ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
22272024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
22282024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22292024-11-09T01:32:39.085ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22302024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
22312024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22322024-11-09T01:32:39.085ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 01:22:39.085680056 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
22332024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
22342024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
22352024-11-09T01:32:39.085ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079
22362024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.32\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079"}
22372024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
22382024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
22392024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
22402024-11-09T01:32:39.085ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
22412024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22422024-11-09T01:32:39.085ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22432024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
22442024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
22452024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
22462024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
22472024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22482024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22492024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
22502024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22512024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
22522024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
22532024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
22542024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22552024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22562024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
22572024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
22582024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
22592024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22602024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22612024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22622024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
22632024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22642024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
22652024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22662024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22672024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
22682024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22692024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22702024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22712024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
22722024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22732024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22742024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
22752024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 10.15\u{b5}s iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
22762024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
22772024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
22782024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.78\u{b5}s iteration = 21 status = {"errors":[],"records_set_to_done":[]}
22792024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
22802024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.35\u{b5}s iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
22812024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
22822024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
22832024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.12\u{b5}s iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
22842024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
22852024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
22862024-11-09T01:32:39.086ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
22872024-11-09T01:32:39.086ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
22882024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22892024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
22902024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22912024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22922024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22932024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22942024-11-09T01:32:39.086ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("34219892-cef8-4169-a366-ce17844120f6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("530f76d0-bec9-4ae0-beb0-d217f68ae05a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("530f76d0-bec9-4ae0-beb0-d217f68ae05a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1276, tv_nsec: 107190508 } })
22952024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22962024-11-09T01:32:39.086ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("30d356ab-a881-4ca3-8f43-203be0381a68.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d55caa1f-cc37-4ecb-b8bf-58b9052db1d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d55caa1f-cc37-4ecb-b8bf-58b9052db1d9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1276, tv_nsec: 107227288 } })
22972024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
22982024-11-09T01:32:39.086ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
22992024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
23002024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
23012024-11-09T01:32:39.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.040762ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
23022024-11-09T01:32:39.087ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
23032024-11-09T01:32:39.087ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.426636ms iteration = 12 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
23042024-11-09T01:32:39.088ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23052024-11-09T01:32:39.088ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23062024-11-09T01:32:39.089ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.271037ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
23072024-11-09T01:32:39.089ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23082024-11-09T01:32:39.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23092024-11-09T01:32:39.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23102024-11-09T01:32:39.090ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1276, tv_nsec: 111279074 } })
23112024-11-09T01:32:39.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23122024-11-09T01:32:39.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
23132024-11-09T01:32:39.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23142024-11-09T01:32:39.090ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
23152024-11-09T01:32:39.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23162024-11-09T01:32:39.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
23172024-11-09T01:32:39.092ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23182024-11-09T01:32:39.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23192024-11-09T01:32:39.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23202024-11-09T01:32:39.097ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23212024-11-09T01:32:39.097ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23222024-11-09T01:32:39.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23232024-11-09T01:32:39.099ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1276, tv_nsec: 120413246 } })
23242024-11-09T01:32:39.100ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
23252024-11-09T01:32:39.100ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 01:22:39.085680056 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
23262024-11-09T01:32:39.100ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.794055ms iteration = 11 status = {"expiration":"2024-11-09T01:22:39.085680056Z","pruned":[]}
23272024-11-09T01:32:39.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23282024-11-09T01:32:39.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23292024-11-09T01:32:39.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23302024-11-09T01:32:39.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
23312024-11-09T01:32:39.101ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23322024-11-09T01:32:39.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23332024-11-09T01:32:39.102ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23342024-11-09T01:32:39.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23352024-11-09T01:32:39.103ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23362024-11-09T01:32:39.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23372024-11-09T01:32:39.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23382024-11-09T01:32:39.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
23392024-11-09T01:32:39.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23402024-11-09T01:32:39.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23412024-11-09T01:32:39.108ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.754973ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
23422024-11-09T01:32:39.108ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23432024-11-09T01:32:39.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23442024-11-09T01:32:39.109ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23452024-11-09T01:32:39.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23462024-11-09T01:32:39.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23472024-11-09T01:32:39.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23482024-11-09T01:32:39.111ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23492024-11-09T01:32:39.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23502024-11-09T01:32:39.112ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1276, tv_nsec: 133652083 } })
23512024-11-09T01:32:39.113ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
23522024-11-09T01:32:39.136ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23532024-11-09T01:32:39.136ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23542024-11-09T01:32:39.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23552024-11-09T01:32:39.137ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23562024-11-09T01:32:39.139ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
23572024-11-09T01:32:39.139ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23582024-11-09T01:32:39.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
23592024-11-09T01:32:39.140ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23602024-11-09T01:32:39.141ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23612024-11-09T01:32:39.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23622024-11-09T01:32:39.142ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 57.41439ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23632024-11-09T01:32:39.143ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23642024-11-09T01:32:39.143ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23652024-11-09T01:32:39.143ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23662024-11-09T01:32:39.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23672024-11-09T01:32:39.145ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23682024-11-09T01:32:39.145ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23692024-11-09T01:32:39.145ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23702024-11-09T01:32:39.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23712024-11-09T01:32:39.146ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23722024-11-09T01:32:39.146ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23732024-11-09T01:32:39.146ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23742024-11-09T01:32:39.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23752024-11-09T01:32:39.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
23762024-11-09T01:32:39.147ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23772024-11-09T01:32:39.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23782024-11-09T01:32:39.147ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23792024-11-09T01:32:39.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23802024-11-09T01:32:39.148ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23812024-11-09T01:32:39.149ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23822024-11-09T01:32:39.149ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
23832024-11-09T01:32:39.149ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
23842024-11-09T01:32:39.149ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 63.803241ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
23852024-11-09T01:32:39.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23862024-11-09T01:32:39.150ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23872024-11-09T01:32:39.150ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23882024-11-09T01:32:39.150ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23892024-11-09T01:32:39.150ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
23902024-11-09T01:32:39.150ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
23912024-11-09T01:32:39.150ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 64.444149ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
23922024-11-09T01:32:39.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23932024-11-09T01:32:39.151ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23942024-11-09T01:32:39.151ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23952024-11-09T01:32:39.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23962024-11-09T01:32:39.153ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23972024-11-09T01:32:39.155ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23982024-11-09T01:32:39.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23992024-11-09T01:32:39.156ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24002024-11-09T01:32:39.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24012024-11-09T01:32:39.156ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
24022024-11-09T01:32:39.156ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24032024-11-09T01:32:39.156ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 71.429356ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
24042024-11-09T01:32:39.156ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.034132ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24052024-11-09T01:32:39.157ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24062024-11-09T01:32:39.158ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24072024-11-09T01:32:39.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
24082024-11-09T01:32:39.160ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24092024-11-09T01:32:39.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24102024-11-09T01:32:39.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c24f6fb-cc5e-4758-a216-4357bbb5d813, lookup_type: ById(8c24f6fb-cc5e-4758-a216-4357bbb5d813) } result = Ok(())
24112024-11-09T01:32:39.161ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24122024-11-09T01:32:39.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24132024-11-09T01:32:39.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24142024-11-09T01:32:39.162ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24152024-11-09T01:32:39.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24162024-11-09T01:32:39.164ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 79.125942ms iteration = 21 status = 0
24172024-11-09T01:32:39.165ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(6f409db2-b593-4add-9f9b-d51dc02a8946, 0), (f6239466-15ee-4485-8e11-b5126fba3341, 0), (b0af5117-b249-4a3e-bffb-9a8beba8121e, 0), (d34e0011-9d7b-4b4d-9906-62bf01a68e6f, 0)] collection_id = 6f409db2-b593-4add-9f9b-d51dc02a8946
24182024-11-09T01:32:39.165ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
24192024-11-09T01:32:39.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
24202024-11-09T01:32:39.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
24212024-11-09T01:32:39.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
24222024-11-09T01:32:39.173ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
24232024-11-09T01:32:39.173ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.244084ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
24242024-11-09T01:32:39.189ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
24252024-11-09T01:32:39.189ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
24262024-11-09T01:32:39.190ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
24272024-11-09T01:32:39.190ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24282024-11-09T01:32:39.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24292024-11-09T01:32:39.191ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
24302024-11-09T01:32:39.191ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
24312024-11-09T01:32:39.191ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
24322024-11-09T01:32:39.191ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24332024-11-09T01:32:39.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24342024-11-09T01:32:39.192ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24352024-11-09T01:32:39.192ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24362024-11-09T01:32:39.192ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24372024-11-09T01:32:39.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24382024-11-09T01:32:39.194ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24392024-11-09T01:32:39.195ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24402024-11-09T01:32:39.195ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24412024-11-09T01:32:39.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24422024-11-09T01:32:39.195ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24432024-11-09T01:32:39.195ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
24442024-11-09T01:32:39.195ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24452024-11-09T01:32:39.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24462024-11-09T01:32:39.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24472024-11-09T01:32:39.196ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24482024-11-09T01:32:39.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24492024-11-09T01:32:39.197ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 6f409db2-b593-4add-9f9b-d51dc02a8946 file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
24502024-11-09T01:32:39.197ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
24512024-11-09T01:32:39.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
24522024-11-09T01:32:39.198ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
24532024-11-09T01:32:39.198ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24542024-11-09T01:32:39.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24552024-11-09T01:32:39.201ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24562024-11-09T01:32:39.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24572024-11-09T01:32:39.202ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24582024-11-09T01:32:39.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24592024-11-09T01:32:39.206ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(f6239466-15ee-4485-8e11-b5126fba3341, 0), (b0af5117-b249-4a3e-bffb-9a8beba8121e, 0), (d34e0011-9d7b-4b4d-9906-62bf01a68e6f, 0)]
24602024-11-09T01:32:39.206ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1276, tv_nsec: 227454279 } })
24612024-11-09T01:32:39.215ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
24622024-11-09T01:32:39.225ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24632024-11-09T01:32:39.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24642024-11-09T01:32:39.236ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
24652024-11-09T01:32:39.236ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 151.053555ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
24662024-11-09T01:32:39.244ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24672024-11-09T01:32:39.244ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24682024-11-09T01:32:39.244ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 158.634349ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24692024-11-09T01:32:39.244ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
24702024-11-09T01:32:39.244ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
24712024-11-09T01:32:39.244ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 72269a3a-73dc-4fb3-8a06-f7b406523664 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
24722024-11-09T01:32:39.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24732024-11-09T01:32:39.244ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24742024-11-09T01:32:39.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24752024-11-09T01:32:39.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24762024-11-09T01:32:39.246ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24772024-11-09T01:32:39.247ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
24782024-11-09T01:32:39.247ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = dadc16e6-e16c-4c3f-bb19-4f189e9d1c26 dns_zone_name = oxide.test found_so_far = 0 version = 2
24792024-11-09T01:32:39.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24802024-11-09T01:32:39.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24812024-11-09T01:32:39.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24822024-11-09T01:32:39.248ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24832024-11-09T01:32:39.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24842024-11-09T01:32:39.255ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
24852024-11-09T01:32:39.255ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 68a9300b-4ce3-4195-acea-76b6ceda997d
24862024-11-09T01:32:39.255ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 1f651961-68e2-4445-8dba-bc37f3cd61d3
24872024-11-09T01:32:39.255ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 942ee949-41da-45ca-aa54-b755650c1f87
24882024-11-09T01:32:39.255ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 1f651961-68e2-4445-8dba-bc37f3cd61d3
24892024-11-09T01:32:39.255ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 68a9300b-4ce3-4195-acea-76b6ceda997d
24902024-11-09T01:32:39.255ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 942ee949-41da-45ca-aa54-b755650c1f87
24912024-11-09T01:32:39.259ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 173.397804ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
24922024-11-09T01:32:39.276ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 190.939139ms iteration = 24 status = {"physical_disks_added":0}
24932024-11-09T01:32:39.316ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba zone_address = fd00:1122:3344:101::2
24942024-11-09T01:32:39.316ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24952024-11-09T01:32:39.317ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f603404d-d043-4f43-a561-287ee9d13f37", "content-length": "26", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
24962024-11-09T01:32:39.317ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24972024-11-09T01:32:39.318ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
24982024-11-09T01:32:39.324ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24992024-11-09T01:32:39.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25002024-11-09T01:32:39.377ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
25012024-11-09T01:32:39.410ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
25022024-11-09T01:32:39.410ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25032024-11-09T01:32:39.410ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e3d2ad6-648b-41c8-8a5b-ebffce67d352", "content-length": "26", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25042024-11-09T01:32:39.410ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25052024-11-09T01:32:39.412ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25062024-11-09T01:32:39.414ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
25072024-11-09T01:32:39.414ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25082024-11-09T01:32:39.414ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "908c225c-2add-4f12-bdea-cada1a2a69e3", "content-length": "26", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25092024-11-09T01:32:39.414ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25102024-11-09T01:32:39.416ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25112024-11-09T01:32:39.471ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
25122024-11-09T01:32:39.471ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "25571d3e-7fec-418d-a028-737dd3ab03c8", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25132024-11-09T01:32:39.471ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25142024-11-09T01:32:39.473ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7962086d-6d9f-42f9-bf2a-8b658a35be2b", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25152024-11-09T01:32:39.473ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25162024-11-09T01:32:39.474ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25172024-11-09T01:32:39.474ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 389.159389ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
25182024-11-09T01:32:39.499ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:61199
25192024-11-09T01:32:39.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61199 req_id = 0e5e916c-5d30-4087-a083-0aead1330e78 roles = RoleSet { roles: {} } uri = /metrics/producers
25202024-11-09T01:32:39.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61199 req_id = 0e5e916c-5d30-4087-a083-0aead1330e78 resource = Database result = Ok(()) uri = /metrics/producers
25212024-11-09T01:32:39.541ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
25222024-11-09T01:32:39.541ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "91648dea-ff39-4e2a-aca7-db91cc73483b", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
25232024-11-09T01:32:39.541ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
25242024-11-09T01:32:39.543ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "901138bd-3531-4be8-988d-81fb0f4cb193", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
25252024-11-09T01:32:39.543ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
25262024-11-09T01:32:39.545ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e845c0aa-f4c5-4a05-9bcb-4733e86ee645", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
25272024-11-09T01:32:39.545ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
25282024-11-09T01:32:39.547ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
25292024-11-09T01:32:39.547ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 461.275242ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
25302024-11-09T01:32:39.592ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
25312024-11-09T01:32:39.592ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
25322024-11-09T01:32:39.593ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
25332024-11-09T01:32:39.593ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a7a8f2f-c436-4857-adfd-8e3222695c86", "content-length": "476", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25342024-11-09T01:32:39.593ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
25352024-11-09T01:32:39.593ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb01efea-8263-4280-96c6-89c195cadf68", "content-length": "734", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25362024-11-09T01:32:39.593ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
25372024-11-09T01:32:39.594ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "46755e91-b261-45a6-bcac-5269d197d7f8", "content-length": "111", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25382024-11-09T01:32:39.594ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
25392024-11-09T01:32:39.594ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6cafe33-60b0-489e-a2e4-d34d6be58623", "content-length": "111", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25402024-11-09T01:32:39.594ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
25412024-11-09T01:32:39.594ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0dd332d4-ba36-46b9-a605-9376cd737756", "content-length": "167", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25422024-11-09T01:32:39.594ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
25432024-11-09T01:32:39.595ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "647614b3-bf15-4f58-a7c0-51a95fbe420a", "content-length": "167", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25442024-11-09T01:32:39.595ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
25452024-11-09T01:32:39.595ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3876c6a6-ca1d-4857-b4f6-af6c613d84ba", "content-length": "175", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25462024-11-09T01:32:39.595ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
25472024-11-09T01:32:39.595ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "10c47712-4388-4a41-ab9e-fd56109b0066", "content-length": "175", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25482024-11-09T01:32:39.595ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
25492024-11-09T01:32:39.595ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb7e98ce-a9fe-434e-809c-15ab68376394", "content-length": "702", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25502024-11-09T01:32:39.595ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
25512024-11-09T01:32:39.596ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c49768f2-d4d1-43a6-a955-1921d50c5afc", "content-length": "727", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25522024-11-09T01:32:39.596ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
25532024-11-09T01:32:39.596ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3577176f-1ee3-4f97-b022-dfb0ce265192", "content-length": "729", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25542024-11-09T01:32:39.596ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
25552024-11-09T01:32:39.596ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1752e35f-cadf-4074-ad58-5650f25527d1", "content-length": "728", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25562024-11-09T01:32:39.596ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
25572024-11-09T01:32:39.596ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8634bf2f-d54d-4cad-8435-6e53d1ad6355", "content-length": "722", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25582024-11-09T01:32:39.596ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
25592024-11-09T01:32:39.597ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fc70fbd-53cd-4360-aea4-2c8c443c3002", "content-length": "109", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25602024-11-09T01:32:39.597ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
25612024-11-09T01:32:39.597ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f2739f5-27ab-4e32-97aa-fe9cc8e153c8", "content-length": "109", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25622024-11-09T01:32:39.597ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
25632024-11-09T01:32:39.597ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "942944fd-cd11-4764-a6fc-0a31db901395", "content-length": "169", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25642024-11-09T01:32:39.597ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
25652024-11-09T01:32:39.597ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4dd408a5-4695-45b1-bddf-7a498de38d45", "content-length": "169", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25662024-11-09T01:32:39.597ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
25672024-11-09T01:32:39.598ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8aae0362-b54d-46d5-864d-4caaa0cfb014", "content-length": "178", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25682024-11-09T01:32:39.598ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
25692024-11-09T01:32:39.598ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "17a1c521-4848-406b-96b7-c45bc133fdd6", "content-length": "178", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25702024-11-09T01:32:39.598ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
25712024-11-09T01:32:39.598ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "17535730-74ba-4202-9ab2-06107e7f62a9", "content-length": "702", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25722024-11-09T01:32:39.598ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
25732024-11-09T01:32:39.598ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bba5d2ce-4885-4434-9352-773a3b2c889e", "content-length": "727", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25742024-11-09T01:32:39.598ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
25752024-11-09T01:32:39.599ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "85b7ee7e-de0e-4a81-a7f9-6c964e8bedab", "content-length": "729", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25762024-11-09T01:32:39.599ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
25772024-11-09T01:32:39.599ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7cf7173-d40d-4f84-9f69-e8aa98ce098b", "content-length": "728", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25782024-11-09T01:32:39.599ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
25792024-11-09T01:32:39.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
25802024-11-09T01:32:39.617ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
25812024-11-09T01:32:39.617ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "284f8f97-80c2-477a-92d7-36efc3a1301a", "content-length": "1", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25822024-11-09T01:32:39.619ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25832024-11-09T01:32:39.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25842024-11-09T01:32:39.625ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 540.430245ms iteration = 21 status = {}
25852024-11-09T01:32:39.638ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
25862024-11-09T01:32:39.638ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25872024-11-09T01:32:39.638ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bc2c4f3-441a-4536-b84a-c7fd6b906372", "content-length": "372", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
25882024-11-09T01:32:39.638ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25892024-11-09T01:32:39.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25902024-11-09T01:32:39.640ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25912024-11-09T01:32:39.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25922024-11-09T01:32:39.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
25932024-11-09T01:32:39.647ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25942024-11-09T01:32:39.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25952024-11-09T01:32:39.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25962024-11-09T01:32:39.649ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25972024-11-09T01:32:39.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25982024-11-09T01:32:39.653ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 567.515247ms iteration = 21 status = null
25992024-11-09T01:32:39.654ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26002024-11-09T01:32:39.654ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = dadc16e6-e16c-4c3f-bb19-4f189e9d1c26 dns_zone_name = oxide.test found_so_far = 1 version = 2
26012024-11-09T01:32:39.654ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
26022024-11-09T01:32:39.654ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 01:23:03.974860 UTC dns_group = external generation = 2
26032024-11-09T01:32:39.654ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 568.916143ms iteration = 12 status = {"generation":2}
26042024-11-09T01:32:39.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26052024-11-09T01:32:39.657ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26062024-11-09T01:32:39.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26072024-11-09T01:32:39.659ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26082024-11-09T01:32:39.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26092024-11-09T01:32:39.661ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26102024-11-09T01:32:39.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26112024-11-09T01:32:39.663ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26122024-11-09T01:32:39.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26132024-11-09T01:32:39.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26142024-11-09T01:32:39.685ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T01:22:35.233443Z, time_modified: 2024-11-09T01:22:35.233443Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 539ccef2-8207-42b1-9e05-00e0a1387c35, db_silo: Silo { identity: SiloIdentity { id: 539ccef2-8207-42b1-9e05-00e0a1387c35, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T01:23:03.926223Z, time_modified: 2024-11-09T01:23:03.926223Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 539ccef2-8207-42b1-9e05-00e0a1387c35, db_silo: Silo { identity: SiloIdentity { id: 539ccef2-8207-42b1-9e05-00e0a1387c35, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T01:23:03.926223Z, time_modified: 2024-11-09T01:23:03.926223Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248" }] }) }
26152024-11-09T01:32:39.685ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 599.892179ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"539ccef2-8207-42b1-9e05-00e0a1387c35","tls_certs":["22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248"]}},"default_endpoint":{"silo_id":"539ccef2-8207-42b1-9e05-00e0a1387c35","tls_certs":["22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
26162024-11-09T01:32:39.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26172024-11-09T01:32:39.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26182024-11-09T01:32:39.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26192024-11-09T01:32:39.688ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26202024-11-09T01:32:39.689ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26212024-11-09T01:32:39.689ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 72269a3a-73dc-4fb3-8a06-f7b406523664 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
26222024-11-09T01:32:39.689ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
26232024-11-09T01:32:39.689ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 01:23:03.098267 UTC dns_group = internal generation = 1
26242024-11-09T01:32:39.689ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 604.030804ms iteration = 12 status = {"generation":1}
26252024-11-09T01:32:39.691ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
26262024-11-09T01:32:39.691ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
26272024-11-09T01:32:39.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
26282024-11-09T01:32:39.691ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26292024-11-09T01:32:39.691ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26302024-11-09T01:32:39.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26312024-11-09T01:32:39.692ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26322024-11-09T01:32:39.693ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26332024-11-09T01:32:39.694ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = 0b7e3a2a-2678-430a-9e61-79da480570a8
26342024-11-09T01:32:39.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 195624 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61199 req_id = 0e5e916c-5d30-4087-a083-0aead1330e78 response_code = 201 uri = /metrics/producers
26352024-11-09T01:32:39.694ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
26362024-11-09T01:32:39.695ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
26372024-11-09T01:32:39.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
26382024-11-09T01:32:39.695ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26392024-11-09T01:32:39.695ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26402024-11-09T01:32:39.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26412024-11-09T01:32:39.703ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26422024-11-09T01:32:39.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26432024-11-09T01:32:39.705ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26442024-11-09T01:32:39.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
26452024-11-09T01:32:39.708ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26462024-11-09T01:32:39.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26472024-11-09T01:32:39.710ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26482024-11-09T01:32:39.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26492024-11-09T01:32:39.712ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26502024-11-09T01:32:39.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26512024-11-09T01:32:39.713ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
26522024-11-09T01:32:39.713ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
26532024-11-09T01:32:39.714ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0e91b1b5-7808-4745-90ab-44753a3e5162", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
26542024-11-09T01:32:39.714ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26552024-11-09T01:32:39.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26562024-11-09T01:32:39.714ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26572024-11-09T01:32:39.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26582024-11-09T01:32:39.716ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26592024-11-09T01:32:39.716ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26602024-11-09T01:32:39.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26612024-11-09T01:32:39.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26622024-11-09T01:32:39.718ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26632024-11-09T01:32:39.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26642024-11-09T01:32:39.719ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26652024-11-09T01:32:39.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26662024-11-09T01:32:39.720ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26672024-11-09T01:32:39.720ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26682024-11-09T01:32:39.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26692024-11-09T01:32:39.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26702024-11-09T01:32:39.721ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26712024-11-09T01:32:39.721ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 68cb9c64-43d4-4c3f-ba7b-013513b8c68d, rack_id: 54080907-d4a8-4f65-b867-da4e2da6d2ba, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8166ae85-b9fa-427c-9f22-e997378e0527) } rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
26722024-11-09T01:32:39.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26732024-11-09T01:32:39.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26742024-11-09T01:32:39.723ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
26752024-11-09T01:32:39.723ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26762024-11-09T01:32:39.723ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "42811ec2-b423-4d35-a756-559ac586d4be", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
26772024-11-09T01:32:39.724ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
26782024-11-09T01:32:39.725ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26792024-11-09T01:32:39.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26802024-11-09T01:32:39.726ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 640.41369ms iteration = 22 status = {}
26812024-11-09T01:32:39.726ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26822024-11-09T01:32:39.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26832024-11-09T01:32:39.731ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26842024-11-09T01:32:39.731ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "23e39f05-1bda-4fd4-a340-70f0a5c1fb47", "content-length": "134", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
26852024-11-09T01:32:39.731ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
26862024-11-09T01:32:39.731ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8166ae85-b9fa-427c-9f22-e997378e0527
26872024-11-09T01:32:39.731ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
26882024-11-09T01:32:39.731ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26892024-11-09T01:32:39.731ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26902024-11-09T01:32:39.731ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26912024-11-09T01:32:39.731ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26922024-11-09T01:32:39.731ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26932024-11-09T01:32:39.732ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26942024-11-09T01:32:39.732ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26952024-11-09T01:32:39.732ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
26962024-11-09T01:32:39.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26972024-11-09T01:32:39.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26982024-11-09T01:32:39.734ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26992024-11-09T01:32:39.734ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "283c9742-e188-4d9b-9ec4-eef14c175159", "content-length": "2", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
27002024-11-09T01:32:39.734ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
27012024-11-09T01:32:39.734ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "efd0b2db-8b72-4318-ac5b-5cc6d7a362cc", "content-length": "52", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
27022024-11-09T01:32:39.734ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
27032024-11-09T01:32:39.734ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27042024-11-09T01:32:39.754ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27052024-11-09T01:32:39.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27062024-11-09T01:32:39.755ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27072024-11-09T01:32:39.762ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
27082024-11-09T01:32:39.762ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27092024-11-09T01:32:39.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27102024-11-09T01:32:39.769ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27112024-11-09T01:32:39.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27122024-11-09T01:32:39.771ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27132024-11-09T01:32:39.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27142024-11-09T01:32:39.774ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27152024-11-09T01:32:39.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27162024-11-09T01:32:39.777ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27172024-11-09T01:32:39.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27182024-11-09T01:32:39.780ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27192024-11-09T01:32:39.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27202024-11-09T01:32:39.782ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27212024-11-09T01:32:39.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27222024-11-09T01:32:39.819ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
27232024-11-09T01:32:39.819ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
27242024-11-09T01:32:39.829ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27252024-11-09T01:32:39.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27262024-11-09T01:32:39.833ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
27272024-11-09T01:32:39.835ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27282024-11-09T01:32:39.841ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
27292024-11-09T01:32:39.841ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27302024-11-09T01:32:39.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27312024-11-09T01:32:39.844ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27322024-11-09T01:32:39.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27332024-11-09T01:32:39.845ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27342024-11-09T01:32:39.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27352024-11-09T01:32:39.847ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27362024-11-09T01:32:39.852ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
27372024-11-09T01:32:39.852ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27382024-11-09T01:32:39.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27392024-11-09T01:32:39.858ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 49d235c5-d54d-4258-a645-9d181875557a, kind: Service { id: 34219892-cef8-4169-a366-ce17844120f6 }, name: Name("external-dns-34219892-cef8-4169-a366-ce17844120f6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce088bfb-77e0-4498-b680-d4fab72b0123, kind: Service { id: 530f76d0-bec9-4ae0-beb0-d217f68ae05a }, name: Name("external-dns-530f76d0-bec9-4ae0-beb0-d217f68ae05a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 314cfeab-323e-4445-9502-7e16efd0a788, kind: Service { id: 86b379c9-5608-41ec-a3b2-837d116869db }, name: Name("nexus-86b379c9-5608-41ec-a3b2-837d116869db"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9fa251a1-2d97-4513-b670-a39f36efe9c9, kind: Service { id: 02562f58-d954-43f9-93a1-2ae8426ccbe9 }, name: Name("nexus-02562f58-d954-43f9-93a1-2ae8426ccbe9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1ef6e1e-4501-48bd-9de3-1d5889b6ea55, kind: Service { id: d59d4e08-d131-4d11-8244-662923dd9357 }, name: Name("nexus-d59d4e08-d131-4d11-8244-662923dd9357"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 166])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
27402024-11-09T01:32:39.858ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27412024-11-09T01:32:39.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27422024-11-09T01:32:39.860ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27432024-11-09T01:32:39.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
27442024-11-09T01:32:39.862ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27452024-11-09T01:32:39.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27462024-11-09T01:32:39.864ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
27472024-11-09T01:32:39.864ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 49d235c5-d54d-4258-a645-9d181875557a, kind: Service { id: 34219892-cef8-4169-a366-ce17844120f6 }, name: Name("external-dns-34219892-cef8-4169-a366-ce17844120f6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ce088bfb-77e0-4498-b680-d4fab72b0123, kind: Service { id: 530f76d0-bec9-4ae0-beb0-d217f68ae05a }, name: Name("external-dns-530f76d0-bec9-4ae0-beb0-d217f68ae05a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 314cfeab-323e-4445-9502-7e16efd0a788, kind: Service { id: 86b379c9-5608-41ec-a3b2-837d116869db }, name: Name("nexus-86b379c9-5608-41ec-a3b2-837d116869db"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 112])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9fa251a1-2d97-4513-b670-a39f36efe9c9, kind: Service { id: 02562f58-d954-43f9-93a1-2ae8426ccbe9 }, name: Name("nexus-02562f58-d954-43f9-93a1-2ae8426ccbe9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b1ef6e1e-4501-48bd-9de3-1d5889b6ea55, kind: Service { id: d59d4e08-d131-4d11-8244-662923dd9357 }, name: Name("nexus-d59d4e08-d131-4d11-8244-662923dd9357"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 166])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
27482024-11-09T01:32:39.864ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
27492024-11-09T01:32:39.887ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "74b70d67-1a7c-4453-9073-4cd76f89ac33", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
27502024-11-09T01:32:39.887ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch = Switch0
27512024-11-09T01:32:39.887ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27522024-11-09T01:32:39.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ed39af9f-5512-44cc-a669-b4ab3780c5a0 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
27532024-11-09T01:32:39.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ed39af9f-5512-44cc-a669-b4ab3780c5a0 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
27542024-11-09T01:32:39.888ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9635d7b-d88f-4a2f-bdc5-dc0a7ebd424b", "content-length": "682", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
27552024-11-09T01:32:39.888ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27562024-11-09T01:32:39.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27572024-11-09T01:32:39.888ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d40e710-9575-4f37-b660-9faaa6896c17", "content-length": "691", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
27582024-11-09T01:32:39.888ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
27592024-11-09T01:32:39.888ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
27602024-11-09T01:32:39.888ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
27612024-11-09T01:32:39.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ed39af9f-5512-44cc-a669-b4ab3780c5a0 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
27622024-11-09T01:32:39.890ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 804.315558ms iteration = 21 status = {}
27632024-11-09T01:32:39.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27642024-11-09T01:32:39.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27652024-11-09T01:32:39.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27662024-11-09T01:32:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27672024-11-09T01:32:39.898ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27682024-11-09T01:32:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27692024-11-09T01:32:39.906ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 821.060715ms iteration = 21 status = {}
27702024-11-09T01:32:39.978ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 8c24f6fb-cc5e-4758-a216-4357bbb5d813, time_created: 2024-11-09T01:23:03.296326Z, time_modified: 2024-11-09T01:23:03.296326Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 54080907-d4a8-4f65-b867-da4e2da6d2ba, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
27712024-11-09T01:32:39.978ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
27722024-11-09T01:32:39.978ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27732024-11-09T01:32:39.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27742024-11-09T01:32:39.980ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27752024-11-09T01:32:39.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27762024-11-09T01:32:39.982ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27772024-11-09T01:32:39.984ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 8c24f6fb-cc5e-4758-a216-4357bbb5d813, lookup_type: ById(8c24f6fb-cc5e-4758-a216-4357bbb5d813) } result = Ok(())
27782024-11-09T01:32:40.018ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27792024-11-09T01:32:40.019ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "4a2095dd-6f8b-4a0a-9e4d-853aef4f7c75", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
27802024-11-09T01:32:40.020ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
27812024-11-09T01:32:40.020ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 934.368438ms
27822024-11-09T01:32:40.020ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 934.378188ms iteration = 3 status = {}
27832024-11-09T01:32:40.188ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "0171a849-fcab-480c-b90b-38b21e27fcbb", "content-length": "30759", "date": "Sat, 09 Nov 2024 01:32:39 GMT"} })
27842024-11-09T01:32:40.191ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
27852024-11-09T01:32:40.191ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
27862024-11-09T01:32:40.191ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
27872024-11-09T01:32:40.193ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
27882024-11-09T01:32:40.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
27892024-11-09T01:32:40.195ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27902024-11-09T01:32:40.198ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
27912024-11-09T01:32:40.198ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
27922024-11-09T01:32:40.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
27932024-11-09T01:32:40.363ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 4136a94a-f28b-4ff5-96d7-19282a3aafc5 file = nexus/db-queries/src/db/datastore/inventory.rs:1000
27942024-11-09T01:32:40.363ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 4136a94a-f28b-4ff5-96d7-19282a3aafc5 time_started = 2024-11-09 01:32:39.592894 UTC
27952024-11-09T01:32:40.363ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.278070051s iteration = 4 status = {"collection_id":"4136a94a-f28b-4ff5-96d7-19282a3aafc5","time_done":"2024-11-09 01:32:40.190984 UTC","time_started":"2024-11-09 01:32:39.592894 UTC"}
27962024-11-09T01:32:40.363ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
27972024-11-09T01:32:40.363ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27982024-11-09T01:32:40.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27992024-11-09T01:32:40.365ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28002024-11-09T01:32:40.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28012024-11-09T01:32:40.367ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28022024-11-09T01:32:40.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28032024-11-09T01:32:40.370ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28042024-11-09T01:32:40.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28052024-11-09T01:32:40.372ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28062024-11-09T01:32:40.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 14566dbb-4c33-4314-9d40-7d8f66e8e741 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
28072024-11-09T01:32:40.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 14566dbb-4c33-4314-9d40-7d8f66e8e741 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
28082024-11-09T01:32:40.375ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28092024-11-09T01:32:40.375ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28102024-11-09T01:32:40.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28112024-11-09T01:32:40.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 14566dbb-4c33-4314-9d40-7d8f66e8e741 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
28122024-11-09T01:32:40.439ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 76.007047ms iteration = 25 status = {"physical_disks_added":0}
28132024-11-09T01:32:40.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = cb867d0f-2c33-4745-8749-dbc40438e0fe roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28142024-11-09T01:32:40.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = cb867d0f-2c33-4745-8749-dbc40438e0fe resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28152024-11-09T01:32:40.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = cb867d0f-2c33-4745-8749-dbc40438e0fe response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28162024-11-09T01:32:41.234ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:63554
28172024-11-09T01:32:41.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63554 req_id = a764d104-02da-47b9-9e65-60c2cd6b4c07 roles = RoleSet { roles: {} } uri = /metrics/producers
28182024-11-09T01:32:41.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63554 req_id = a764d104-02da-47b9-9e65-60c2cd6b4c07 resource = Database result = Ok(()) uri = /metrics/producers
28192024-11-09T01:32:41.268ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
28202024-11-09T01:32:41.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34424 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63554 req_id = a764d104-02da-47b9-9e65-60c2cd6b4c07 response_code = 201 uri = /metrics/producers
28212024-11-09T01:32:41.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bafbcf05-2b93-4630-84f5-cff9032fc43c roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28222024-11-09T01:32:41.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bafbcf05-2b93-4630-84f5-cff9032fc43c resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28232024-11-09T01:32:41.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2455 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bafbcf05-2b93-4630-84f5-cff9032fc43c response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28242024-11-09T01:32:42.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2be99728-8e45-4dd2-ac1d-0d0726ff81ad roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28252024-11-09T01:32:42.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2be99728-8e45-4dd2-ac1d-0d0726ff81ad resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28262024-11-09T01:32:42.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2854 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2be99728-8e45-4dd2-ac1d-0d0726ff81ad response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28272024-11-09T01:32:43.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 82239bcd-0142-42a1-8953-24ea8d612c8b roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28282024-11-09T01:32:43.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 82239bcd-0142-42a1-8953-24ea8d612c8b resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28292024-11-09T01:32:43.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2512 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 82239bcd-0142-42a1-8953-24ea8d612c8b response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28302024-11-09T01:32:44.971ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1625 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = 0eb3bc9f-b211-4908-a403-cc539e9764d9 response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
28312024-11-09T01:32:45.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 73c85a7d-ea20-44a1-b895-c8e8e69c50f8 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28322024-11-09T01:32:45.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 73c85a7d-ea20-44a1-b895-c8e8e69c50f8 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28332024-11-09T01:32:45.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2776 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 73c85a7d-ea20-44a1-b895-c8e8e69c50f8 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28342024-11-09T01:32:45.774ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:33894
28352024-11-09T01:32:45.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33894 req_id = 195d4cce-a4b4-44da-a6c1-d28721767c6b roles = RoleSet { roles: {} } uri = /metrics/producers
28362024-11-09T01:32:45.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33894 req_id = 195d4cce-a4b4-44da-a6c1-d28721767c6b resource = Database result = Ok(()) uri = /metrics/producers
28372024-11-09T01:32:45.788ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = ae2532a5-1acb-4cb0-9e42-a49469d3ac6e
28382024-11-09T01:32:45.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 14266 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33894 req_id = 195d4cce-a4b4-44da-a6c1-d28721767c6b response_code = 201 uri = /metrics/producers
28392024-11-09T01:32:46.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 177443b8-cbdb-4b71-b7dd-3449235cfbd2 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28402024-11-09T01:32:46.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 177443b8-cbdb-4b71-b7dd-3449235cfbd2 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28412024-11-09T01:32:46.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 177443b8-cbdb-4b71-b7dd-3449235cfbd2 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28422024-11-09T01:32:47.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 1beddd26-05c3-42ea-9ea0-448061a53bab roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28432024-11-09T01:32:47.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 1beddd26-05c3-42ea-9ea0-448061a53bab resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28442024-11-09T01:32:47.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2562 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 1beddd26-05c3-42ea-9ea0-448061a53bab response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28452024-11-09T01:32:47.280ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:63169
28462024-11-09T01:32:47.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63169 req_id = c15176f1-54b3-40b6-9d99-0aad89f37f02 roles = RoleSet { roles: {} } uri = /metrics/producers
28472024-11-09T01:32:47.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63169 req_id = c15176f1-54b3-40b6-9d99-0aad89f37f02 resource = Database result = Ok(()) uri = /metrics/producers
28482024-11-09T01:32:47.316ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = 280d8787-5c87-4881-b4ab-42b6418a5800
28492024-11-09T01:32:47.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35059 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63169 req_id = c15176f1-54b3-40b6-9d99-0aad89f37f02 response_code = 201 uri = /metrics/producers
28502024-11-09T01:32:48.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a0f7ceae-b02d-4e97-b533-2a25e1df297a roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28512024-11-09T01:32:48.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a0f7ceae-b02d-4e97-b533-2a25e1df297a resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28522024-11-09T01:32:48.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a0f7ceae-b02d-4e97-b533-2a25e1df297a response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28532024-11-09T01:32:48.872ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:36839
28542024-11-09T01:32:48.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36839 req_id = a336b459-60f0-42e9-8766-03847e3abe52 roles = RoleSet { roles: {} } uri = /metrics/producers
28552024-11-09T01:32:48.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36839 req_id = a336b459-60f0-42e9-8766-03847e3abe52 resource = Database result = Ok(()) uri = /metrics/producers
28562024-11-09T01:32:48.882ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = 48c53f41-2154-4790-bde9-4c822a898bb2
28572024-11-09T01:32:48.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9881 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36839 req_id = a336b459-60f0-42e9-8766-03847e3abe52 response_code = 201 uri = /metrics/producers
28582024-11-09T01:32:49.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
28592024-11-09T01:32:49.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
28602024-11-09T01:32:49.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28612024-11-09T01:32:49.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28622024-11-09T01:32:49.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28632024-11-09T01:32:49.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28642024-11-09T01:32:49.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28652024-11-09T01:32:49.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28662024-11-09T01:32:49.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28672024-11-09T01:32:49.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28682024-11-09T01:32:49.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28692024-11-09T01:32:49.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28702024-11-09T01:32:49.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28712024-11-09T01:32:49.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
28722024-11-09T01:32:49.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28732024-11-09T01:32:49.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28742024-11-09T01:32:49.106ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
28752024-11-09T01:32:49.106ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.239297ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
28762024-11-09T01:32:49.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 93554a79-fc7b-47f7-a341-1c87d910dfb3 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28772024-11-09T01:32:49.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 93554a79-fc7b-47f7-a341-1c87d910dfb3 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28782024-11-09T01:32:49.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1626 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 93554a79-fc7b-47f7-a341-1c87d910dfb3 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28792024-11-09T01:32:49.115ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28802024-11-09T01:32:49.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28812024-11-09T01:32:49.141ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.306118ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28822024-11-09T01:32:49.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 5be79a49-2334-4782-8daf-b772639e66ee roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
28832024-11-09T01:32:49.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 5be79a49-2334-4782-8daf-b772639e66ee resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
28842024-11-09T01:32:49.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 5be79a49-2334-4782-8daf-b772639e66ee response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
28852024-11-09T01:32:49.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 819b272f-952d-4dea-ae51-de5f82495b28 roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
28862024-11-09T01:32:49.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 819b272f-952d-4dea-ae51-de5f82495b28 resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
28872024-11-09T01:32:49.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 819b272f-952d-4dea-ae51-de5f82495b28 response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
28882024-11-09T01:32:50.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a0f91c62-3763-411b-867c-bc6e9e05a90e roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28892024-11-09T01:32:50.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a0f91c62-3763-411b-867c-bc6e9e05a90e resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28902024-11-09T01:32:50.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1581 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a0f91c62-3763-411b-867c-bc6e9e05a90e response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28912024-11-09T01:32:51.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2fc1bc71-3fba-4639-ab1c-14ade5e32020 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28922024-11-09T01:32:51.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2fc1bc71-3fba-4639-ab1c-14ade5e32020 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28932024-11-09T01:32:51.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2fc1bc71-3fba-4639-ab1c-14ade5e32020 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28942024-11-09T01:32:52.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e503c9f8-d391-4f93-9324-e5253460bc1c roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28952024-11-09T01:32:52.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e503c9f8-d391-4f93-9324-e5253460bc1c resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28962024-11-09T01:32:52.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1966 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e503c9f8-d391-4f93-9324-e5253460bc1c response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28972024-11-09T01:32:53.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d45073be-a30d-477b-9a97-1dd4432d4e88 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28982024-11-09T01:32:53.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d45073be-a30d-477b-9a97-1dd4432d4e88 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
28992024-11-09T01:32:53.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d45073be-a30d-477b-9a97-1dd4432d4e88 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29002024-11-09T01:32:54.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c9971582-82cb-4407-a64b-627fd1925088 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29012024-11-09T01:32:54.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c9971582-82cb-4407-a64b-627fd1925088 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29022024-11-09T01:32:54.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c9971582-82cb-4407-a64b-627fd1925088 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29032024-11-09T01:32:55.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a80c95d6-7ce0-4b24-afb8-811c9fe83db9 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29042024-11-09T01:32:55.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a80c95d6-7ce0-4b24-afb8-811c9fe83db9 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29052024-11-09T01:32:55.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a80c95d6-7ce0-4b24-afb8-811c9fe83db9 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29062024-11-09T01:32:56.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d6183f5d-5614-4bda-a097-1d2660014f92 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29072024-11-09T01:32:56.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d6183f5d-5614-4bda-a097-1d2660014f92 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29082024-11-09T01:32:56.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d6183f5d-5614-4bda-a097-1d2660014f92 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29092024-11-09T01:32:57.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19183382-6c89-4ed4-a804-327f097bce66 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29102024-11-09T01:32:57.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19183382-6c89-4ed4-a804-327f097bce66 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29112024-11-09T01:32:57.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19183382-6c89-4ed4-a804-327f097bce66 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29122024-11-09T01:32:58.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bbfa44ef-894f-4a18-99ed-22a4aeb1a85e roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29132024-11-09T01:32:58.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bbfa44ef-894f-4a18-99ed-22a4aeb1a85e resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29142024-11-09T01:32:58.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bbfa44ef-894f-4a18-99ed-22a4aeb1a85e response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29152024-11-09T01:32:59.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
29162024-11-09T01:32:59.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
29172024-11-09T01:32:59.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29182024-11-09T01:32:59.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29192024-11-09T01:32:59.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29202024-11-09T01:32:59.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29212024-11-09T01:32:59.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29222024-11-09T01:32:59.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29232024-11-09T01:32:59.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29242024-11-09T01:32:59.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29252024-11-09T01:32:59.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29262024-11-09T01:32:59.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29272024-11-09T01:32:59.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29282024-11-09T01:32:59.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
29292024-11-09T01:32:59.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29302024-11-09T01:32:59.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29312024-11-09T01:32:59.114ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
29322024-11-09T01:32:59.114ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.171454ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
29332024-11-09T01:32:59.121ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29342024-11-09T01:32:59.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29352024-11-09T01:32:59.148ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.511507ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29362024-11-09T01:32:59.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f5fd461e-54d4-490e-95e7-55de91ddedb1 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29372024-11-09T01:32:59.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f5fd461e-54d4-490e-95e7-55de91ddedb1 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29382024-11-09T01:32:59.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f5fd461e-54d4-490e-95e7-55de91ddedb1 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29392024-11-09T01:32:59.970ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1417 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = 0600223f-db36-4226-8723-6533d956c07f response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
29402024-11-09T01:33:00.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 38a13b4a-dd1b-4c74-ba16-47d786e5e211 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29412024-11-09T01:33:00.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 38a13b4a-dd1b-4c74-ba16-47d786e5e211 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29422024-11-09T01:33:00.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 38a13b4a-dd1b-4c74-ba16-47d786e5e211 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29432024-11-09T01:33:01.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f7089a83-b743-42b9-92ea-2d15331751c7 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29442024-11-09T01:33:01.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f7089a83-b743-42b9-92ea-2d15331751c7 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29452024-11-09T01:33:01.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f7089a83-b743-42b9-92ea-2d15331751c7 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29462024-11-09T01:33:02.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3c2fd22a-c1ed-4f67-9a6b-2e0a44674bb8 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29472024-11-09T01:33:02.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3c2fd22a-c1ed-4f67-9a6b-2e0a44674bb8 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29482024-11-09T01:33:02.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3c2fd22a-c1ed-4f67-9a6b-2e0a44674bb8 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29492024-11-09T01:33:03.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f68218d0-132f-47e5-bd3d-07ad0b7e01a3 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29502024-11-09T01:33:03.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f68218d0-132f-47e5-bd3d-07ad0b7e01a3 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29512024-11-09T01:33:03.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2023 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f68218d0-132f-47e5-bd3d-07ad0b7e01a3 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29522024-11-09T01:33:04.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 157dd3f7-85c8-4cea-a4e0-da45257550c8 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29532024-11-09T01:33:04.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 157dd3f7-85c8-4cea-a4e0-da45257550c8 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29542024-11-09T01:33:04.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 157dd3f7-85c8-4cea-a4e0-da45257550c8 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29552024-11-09T01:33:05.371ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
29562024-11-09T01:33:05.371ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
29572024-11-09T01:33:05.402ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
29582024-11-09T01:33:05.402ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:43330
29592024-11-09T01:33:05.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:43330 req_id = 73e19dd9-4fda-472e-b661-e8022a65f05a roles = RoleSet { roles: {} } uri = /metrics/producers
29602024-11-09T01:33:05.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:43330 req_id = 73e19dd9-4fda-472e-b661-e8022a65f05a resource = Database result = Ok(()) uri = /metrics/producers
29612024-11-09T01:33:05.445ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
29622024-11-09T01:33:05.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43613 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:43330 req_id = 73e19dd9-4fda-472e-b661-e8022a65f05a response_code = 201 uri = /metrics/producers
29632024-11-09T01:33:05.445ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "73e19dd9-4fda-472e-b661-e8022a65f05a", "content-length": "41", "date": "Sat, 09 Nov 2024 01:33:05 GMT"} })
29642024-11-09T01:33:05.446ZDEBGnexus (producer-registration-task): registered with nexus successfully
29652024-11-09T01:33:05.446ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
29662024-11-09T01:33:05.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bc7e9ad9-5a4e-4dfb-b32f-c78da0813a6f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29672024-11-09T01:33:05.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bc7e9ad9-5a4e-4dfb-b32f-c78da0813a6f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29682024-11-09T01:33:05.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bc7e9ad9-5a4e-4dfb-b32f-c78da0813a6f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29692024-11-09T01:33:06.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = debf06d8-ad55-4caa-bb7d-2c1734759576 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29702024-11-09T01:33:06.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = debf06d8-ad55-4caa-bb7d-2c1734759576 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29712024-11-09T01:33:06.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1959 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = debf06d8-ad55-4caa-bb7d-2c1734759576 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29722024-11-09T01:33:07.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8ddabe4f-8816-4e6b-a7f8-cd0435d39544 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29732024-11-09T01:33:07.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8ddabe4f-8816-4e6b-a7f8-cd0435d39544 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29742024-11-09T01:33:07.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1865 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8ddabe4f-8816-4e6b-a7f8-cd0435d39544 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29752024-11-09T01:33:08.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9af89139-4619-4f07-b397-4017862ab80d roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29762024-11-09T01:33:08.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9af89139-4619-4f07-b397-4017862ab80d resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29772024-11-09T01:33:08.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9af89139-4619-4f07-b397-4017862ab80d response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
29782024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
29792024-11-09T01:33:09.086ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
29802024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
29812024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29822024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29832024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
29842024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29852024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
29862024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29872024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
29882024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
29892024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29902024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
29912024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
29922024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
29932024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
29942024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29952024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29962024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29972024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
29982024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
29992024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30002024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30012024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
30022024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
30032024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30042024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30052024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
30062024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.18\u{b5}s iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
30072024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
30082024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.53\u{b5}s iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
30092024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
30102024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.18\u{b5}s iteration = 22 status = {"errors":[],"records_set_to_done":[]}
30112024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
30122024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 19.4\u{b5}s iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
30132024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30142024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30152024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30162024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30172024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30182024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30192024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30202024-11-09T01:33:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30212024-11-09T01:33:09.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30222024-11-09T01:33:09.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30232024-11-09T01:33:09.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30242024-11-09T01:33:09.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30252024-11-09T01:33:09.088ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30262024-11-09T01:33:09.089ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30272024-11-09T01:33:09.089ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30282024-11-09T01:33:09.090ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.969354ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
30292024-11-09T01:33:09.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30302024-11-09T01:33:09.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
30312024-11-09T01:33:09.092ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30322024-11-09T01:33:09.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30332024-11-09T01:33:09.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
30342024-11-09T01:33:09.092ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30352024-11-09T01:33:09.092ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30362024-11-09T01:33:09.092ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30372024-11-09T01:33:09.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30382024-11-09T01:33:09.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30392024-11-09T01:33:09.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30402024-11-09T01:33:09.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30412024-11-09T01:33:09.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30422024-11-09T01:33:09.095ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30432024-11-09T01:33:09.096ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1306, tv_nsec: 116571883 } })
30442024-11-09T01:33:09.096ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
30452024-11-09T01:33:09.096ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1306, tv_nsec: 117229060 } })
30462024-11-09T01:33:09.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30472024-11-09T01:33:09.096ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30482024-11-09T01:33:09.097ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
30492024-11-09T01:33:09.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30502024-11-09T01:33:09.098ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30512024-11-09T01:33:09.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30522024-11-09T01:33:09.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30532024-11-09T01:33:09.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30542024-11-09T01:33:09.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30552024-11-09T01:33:09.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30562024-11-09T01:33:09.101ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30572024-11-09T01:33:09.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30582024-11-09T01:33:09.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30592024-11-09T01:33:09.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30602024-11-09T01:33:09.124ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30612024-11-09T01:33:09.124ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
30622024-11-09T01:33:09.124ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30632024-11-09T01:33:09.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30642024-11-09T01:33:09.128ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30652024-11-09T01:33:09.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30662024-11-09T01:33:09.132ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30672024-11-09T01:33:09.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30682024-11-09T01:33:09.135ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30692024-11-09T01:33:09.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30702024-11-09T01:33:09.138ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30712024-11-09T01:33:09.139ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30722024-11-09T01:33:09.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
30732024-11-09T01:33:09.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30742024-11-09T01:33:09.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30752024-11-09T01:33:09.140ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
30762024-11-09T01:33:09.140ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 54.675319ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
30772024-11-09T01:33:09.141ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30782024-11-09T01:33:09.141ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30792024-11-09T01:33:09.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30802024-11-09T01:33:09.143ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1306, tv_nsec: 163796859 } })
30812024-11-09T01:33:09.143ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30822024-11-09T01:33:09.143ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
30832024-11-09T01:33:09.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30842024-11-09T01:33:09.147ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 61.474336ms iteration = 26 status = {"physical_disks_added":0}
30852024-11-09T01:33:09.149ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30862024-11-09T01:33:09.150ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30872024-11-09T01:33:09.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30882024-11-09T01:33:09.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
30892024-11-09T01:33:09.152ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30902024-11-09T01:33:09.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30912024-11-09T01:33:09.155ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30922024-11-09T01:33:09.155ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30932024-11-09T01:33:09.155ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30942024-11-09T01:33:09.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30952024-11-09T01:33:09.157ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
30962024-11-09T01:33:09.157ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30972024-11-09T01:33:09.157ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 71.166114ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30982024-11-09T01:33:09.157ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dadad6aa-0670-4ea8-85f0-077b2289b3df", "content-length": "26", "date": "Sat, 09 Nov 2024 01:33:09 GMT"} })
30992024-11-09T01:33:09.157ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31002024-11-09T01:33:09.159ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31012024-11-09T01:33:09.174ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
31022024-11-09T01:33:09.174ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.552557ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
31032024-11-09T01:33:09.178ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31042024-11-09T01:33:09.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c24f6fb-cc5e-4758-a216-4357bbb5d813, lookup_type: ById(8c24f6fb-cc5e-4758-a216-4357bbb5d813) } result = Ok(())
31052024-11-09T01:33:09.180ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31062024-11-09T01:33:09.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31072024-11-09T01:33:09.182ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 96.8281ms iteration = 22 status = 0
31082024-11-09T01:33:09.187ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 101.014106ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31092024-11-09T01:33:09.195ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31102024-11-09T01:33:09.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31112024-11-09T01:33:09.197ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31122024-11-09T01:33:09.197ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
31132024-11-09T01:33:09.197ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 110.924867ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
31142024-11-09T01:33:09.197ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31152024-11-09T01:33:09.199ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31162024-11-09T01:33:09.199ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31172024-11-09T01:33:09.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31182024-11-09T01:33:09.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31192024-11-09T01:33:09.202ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31202024-11-09T01:33:09.202ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31212024-11-09T01:33:09.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31222024-11-09T01:33:09.204ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
31232024-11-09T01:33:09.204ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31242024-11-09T01:33:09.204ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c51df0b9-7e85-4b2f-bb5f-360e213cc76f", "content-length": "26", "date": "Sat, 09 Nov 2024 01:33:09 GMT"} })
31252024-11-09T01:33:09.204ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31262024-11-09T01:33:09.207ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31272024-11-09T01:33:09.302ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 216.255601ms iteration = 22 status = {}
31282024-11-09T01:33:09.311ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
31292024-11-09T01:33:09.311ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31302024-11-09T01:33:09.311ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba zone_address = fd00:1122:3344:101::2
31312024-11-09T01:33:09.311ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31322024-11-09T01:33:09.311ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "13acd410-cadc-4cb1-b1f3-3644c197150f", "content-length": "26", "date": "Sat, 09 Nov 2024 01:33:09 GMT"} })
31332024-11-09T01:33:09.311ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31342024-11-09T01:33:09.312ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a97f0ca9-3062-4d85-9a02-c98571bcafac", "content-length": "372", "date": "Sat, 09 Nov 2024 01:33:09 GMT"} })
31352024-11-09T01:33:09.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31362024-11-09T01:33:09.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31372024-11-09T01:33:09.313ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
31382024-11-09T01:33:09.328ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
31392024-11-09T01:33:09.328ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cf81bd3-4c78-44f1-8c5e-ce4931a774b6", "content-length": "691", "date": "Sat, 09 Nov 2024 01:33:09 GMT"} })
31402024-11-09T01:33:09.328ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
31412024-11-09T01:33:09.328ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
31422024-11-09T01:33:09.328ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
31432024-11-09T01:33:09.329ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 243.341194ms iteration = 22 status = {}
31442024-11-09T01:33:09.353ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
31452024-11-09T01:33:09.353ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
31462024-11-09T01:33:09.354ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d3565172-c3d4-420b-ac41-faa4c3c04164", "date": "Sat, 09 Nov 2024 01:33:09 GMT"} })
31472024-11-09T01:33:09.354ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31482024-11-09T01:33:09.354ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
31492024-11-09T01:33:09.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31502024-11-09T01:33:09.354ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bc0b2db-e23e-4d25-aaba-ddd85d140161", "content-length": "1", "date": "Sat, 09 Nov 2024 01:33:08 GMT"} })
31512024-11-09T01:33:09.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31522024-11-09T01:33:09.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31532024-11-09T01:33:09.356ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31542024-11-09T01:33:09.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31552024-11-09T01:33:09.358ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 271.961223ms iteration = 22 status = null
31562024-11-09T01:33:09.359ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31572024-11-09T01:33:09.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31582024-11-09T01:33:09.363ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
31592024-11-09T01:33:09.363ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31602024-11-09T01:33:09.363ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "08451a1c-bdb0-4f50-8ffa-538d1869a181", "date": "Sat, 09 Nov 2024 01:33:09 GMT"} })
31612024-11-09T01:33:09.364ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 278.653337ms iteration = 23 status = {}
31622024-11-09T01:33:09.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31632024-11-09T01:33:09.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31642024-11-09T01:33:09.429ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 68cb9c64-43d4-4c3f-ba7b-013513b8c68d, rack_id: 54080907-d4a8-4f65-b867-da4e2da6d2ba, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8166ae85-b9fa-427c-9f22-e997378e0527) } rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
31652024-11-09T01:33:09.429ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31662024-11-09T01:33:09.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31672024-11-09T01:33:09.439ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
31682024-11-09T01:33:09.439ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "040dee0e-38bd-4f6c-81a4-838f44025e00", "content-length": "134", "date": "Sat, 09 Nov 2024 01:33:08 GMT"} })
31692024-11-09T01:33:09.439ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
31702024-11-09T01:33:09.439ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8166ae85-b9fa-427c-9f22-e997378e0527
31712024-11-09T01:33:09.439ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
31722024-11-09T01:33:09.439ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
31732024-11-09T01:33:09.439ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31742024-11-09T01:33:09.439ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31752024-11-09T01:33:09.439ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31762024-11-09T01:33:09.439ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31772024-11-09T01:33:09.439ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31782024-11-09T01:33:09.439ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31792024-11-09T01:33:09.440ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
31802024-11-09T01:33:09.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31812024-11-09T01:33:09.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31822024-11-09T01:33:09.442ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
31832024-11-09T01:33:09.442ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fdedc2d-47ac-4aba-a743-67c182558113", "content-length": "2", "date": "Sat, 09 Nov 2024 01:33:08 GMT"} })
31842024-11-09T01:33:09.442ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
31852024-11-09T01:33:09.442ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a582fbc8-458a-4050-a7f1-74578e9fb5e9", "content-length": "52", "date": "Sat, 09 Nov 2024 01:33:08 GMT"} })
31862024-11-09T01:33:09.442ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
31872024-11-09T01:33:09.442ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
31882024-11-09T01:33:09.590ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5c8d1923-f274-41e5-a9aa-7e9cdd000f44", "date": "Sat, 09 Nov 2024 01:33:09 GMT"} })
31892024-11-09T01:33:09.590ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch = Switch0
31902024-11-09T01:33:09.590ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
31912024-11-09T01:33:09.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2ca65a9c-537c-40ba-bf05-8ea951491f0f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
31922024-11-09T01:33:09.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2ca65a9c-537c-40ba-bf05-8ea951491f0f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
31932024-11-09T01:33:09.590ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd9592e0-f246-4c92-8806-0f8d160f6a6c", "content-length": "682", "date": "Sat, 09 Nov 2024 01:33:09 GMT"} })
31942024-11-09T01:33:09.590ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31952024-11-09T01:33:09.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31962024-11-09T01:33:09.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2ca65a9c-537c-40ba-bf05-8ea951491f0f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
31972024-11-09T01:33:09.595ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31982024-11-09T01:33:09.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31992024-11-09T01:33:09.598ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32002024-11-09T01:33:09.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32012024-11-09T01:33:09.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32022024-11-09T01:33:09.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32032024-11-09T01:33:09.610ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 524.087874ms iteration = 22 status = {}
32042024-11-09T01:33:10.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 8ec94ae0-1482-4b2b-bc87-ab030abd986f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
32052024-11-09T01:33:10.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 8ec94ae0-1482-4b2b-bc87-ab030abd986f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
32062024-11-09T01:33:10.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 8ec94ae0-1482-4b2b-bc87-ab030abd986f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
32072024-11-09T01:33:10.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bbd36c94-75e6-48b5-8e59-e9dc6c485d84 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32082024-11-09T01:33:10.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bbd36c94-75e6-48b5-8e59-e9dc6c485d84 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32092024-11-09T01:33:10.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bbd36c94-75e6-48b5-8e59-e9dc6c485d84 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32102024-11-09T01:33:11.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6bc21f4d-d9ed-4860-814b-6d9b98398d8a roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32112024-11-09T01:33:11.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6bc21f4d-d9ed-4860-814b-6d9b98398d8a resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32122024-11-09T01:33:11.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6bc21f4d-d9ed-4860-814b-6d9b98398d8a response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32132024-11-09T01:33:12.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5e9915fb-9b2a-4982-85e5-1d910075d5a4 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32142024-11-09T01:33:12.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5e9915fb-9b2a-4982-85e5-1d910075d5a4 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32152024-11-09T01:33:12.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5e9915fb-9b2a-4982-85e5-1d910075d5a4 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32162024-11-09T01:33:13.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8362202a-7e67-4ada-b0b4-f67e0fcd4eff roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32172024-11-09T01:33:13.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8362202a-7e67-4ada-b0b4-f67e0fcd4eff resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32182024-11-09T01:33:13.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8362202a-7e67-4ada-b0b4-f67e0fcd4eff response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32192024-11-09T01:33:14.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 18be349a-6339-424c-9c01-5c9f2d5efe44 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32202024-11-09T01:33:14.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 18be349a-6339-424c-9c01-5c9f2d5efe44 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32212024-11-09T01:33:14.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2611 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 18be349a-6339-424c-9c01-5c9f2d5efe44 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32222024-11-09T01:33:14.970ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1272 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = 6dec849a-16a9-4558-acbc-f106e66909e6 response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
32232024-11-09T01:33:15.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ac96966f-086c-4099-b944-6f971e40a195 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32242024-11-09T01:33:15.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ac96966f-086c-4099-b944-6f971e40a195 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32252024-11-09T01:33:15.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2232 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ac96966f-086c-4099-b944-6f971e40a195 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32262024-11-09T01:33:16.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 40904334-c76a-4253-bd73-26ed46b4fc8b roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32272024-11-09T01:33:16.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 40904334-c76a-4253-bd73-26ed46b4fc8b resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32282024-11-09T01:33:16.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1935 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 40904334-c76a-4253-bd73-26ed46b4fc8b response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32292024-11-09T01:33:17.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b6916f10-9ffc-4b77-b2c5-315555ba714a roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32302024-11-09T01:33:17.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b6916f10-9ffc-4b77-b2c5-315555ba714a resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32312024-11-09T01:33:17.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b6916f10-9ffc-4b77-b2c5-315555ba714a response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32322024-11-09T01:33:18.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a0dff8a7-6350-462c-9e26-1a0368cc98eb roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32332024-11-09T01:33:18.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a0dff8a7-6350-462c-9e26-1a0368cc98eb resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32342024-11-09T01:33:18.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a0dff8a7-6350-462c-9e26-1a0368cc98eb response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32352024-11-09T01:33:19.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
32362024-11-09T01:33:19.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
32372024-11-09T01:33:19.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32382024-11-09T01:33:19.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32392024-11-09T01:33:19.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32402024-11-09T01:33:19.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32412024-11-09T01:33:19.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32422024-11-09T01:33:19.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32432024-11-09T01:33:19.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32442024-11-09T01:33:19.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32452024-11-09T01:33:19.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32462024-11-09T01:33:19.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32472024-11-09T01:33:19.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32482024-11-09T01:33:19.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
32492024-11-09T01:33:19.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32502024-11-09T01:33:19.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32512024-11-09T01:33:19.108ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
32522024-11-09T01:33:19.108ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.327219ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
32532024-11-09T01:33:19.115ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32542024-11-09T01:33:19.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32552024-11-09T01:33:19.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.452261ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32562024-11-09T01:33:19.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9d15807d-d88e-4574-b226-7e833a17853c roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32572024-11-09T01:33:19.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9d15807d-d88e-4574-b226-7e833a17853c resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32582024-11-09T01:33:19.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2334 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9d15807d-d88e-4574-b226-7e833a17853c response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32592024-11-09T01:33:19.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 447abf02-6880-4564-8521-f4ecc5211960 roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
32602024-11-09T01:33:19.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 447abf02-6880-4564-8521-f4ecc5211960 resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
32612024-11-09T01:33:19.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2760 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 447abf02-6880-4564-8521-f4ecc5211960 response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
32622024-11-09T01:33:19.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = c6d73087-93b2-4115-891c-3f45f94719e1 roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
32632024-11-09T01:33:19.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = c6d73087-93b2-4115-891c-3f45f94719e1 resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
32642024-11-09T01:33:19.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2517 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = c6d73087-93b2-4115-891c-3f45f94719e1 response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
32652024-11-09T01:33:20.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ef42369f-2823-42bf-ab44-49d0e5a7e61f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32662024-11-09T01:33:20.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ef42369f-2823-42bf-ab44-49d0e5a7e61f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32672024-11-09T01:33:20.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ef42369f-2823-42bf-ab44-49d0e5a7e61f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32682024-11-09T01:33:21.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8ba0ee8a-872a-4c6d-84ec-59f16b68d8fa roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32692024-11-09T01:33:21.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8ba0ee8a-872a-4c6d-84ec-59f16b68d8fa resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32702024-11-09T01:33:21.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8ba0ee8a-872a-4c6d-84ec-59f16b68d8fa response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32712024-11-09T01:33:22.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0305f396-37c4-47ef-bebc-eeb8390fd94f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32722024-11-09T01:33:22.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0305f396-37c4-47ef-bebc-eeb8390fd94f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32732024-11-09T01:33:22.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2660 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0305f396-37c4-47ef-bebc-eeb8390fd94f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32742024-11-09T01:33:23.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4b3b61b2-6a3c-4a39-b37e-fc20e0508d30 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32752024-11-09T01:33:23.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4b3b61b2-6a3c-4a39-b37e-fc20e0508d30 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32762024-11-09T01:33:23.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2620 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4b3b61b2-6a3c-4a39-b37e-fc20e0508d30 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32772024-11-09T01:33:24.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 98eaaf69-091a-4f8d-9b11-5f56d81d1b0f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32782024-11-09T01:33:24.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 98eaaf69-091a-4f8d-9b11-5f56d81d1b0f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32792024-11-09T01:33:24.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 98eaaf69-091a-4f8d-9b11-5f56d81d1b0f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32802024-11-09T01:33:25.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 15cee8bf-2f2c-4bb0-8480-e2b04cda1dcc roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32812024-11-09T01:33:25.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 15cee8bf-2f2c-4bb0-8480-e2b04cda1dcc resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32822024-11-09T01:33:25.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 15cee8bf-2f2c-4bb0-8480-e2b04cda1dcc response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32832024-11-09T01:33:26.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d374a344-7862-4619-a26e-4eff664a4df9 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32842024-11-09T01:33:26.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d374a344-7862-4619-a26e-4eff664a4df9 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32852024-11-09T01:33:26.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2556 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d374a344-7862-4619-a26e-4eff664a4df9 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32862024-11-09T01:33:28.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = fb051723-a9eb-4551-99d6-4b97f48a6b1a roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32872024-11-09T01:33:28.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = fb051723-a9eb-4551-99d6-4b97f48a6b1a resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32882024-11-09T01:33:28.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = fb051723-a9eb-4551-99d6-4b97f48a6b1a response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32892024-11-09T01:33:29.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 67b54e2d-5710-4c01-b41f-50f95e60aba1 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32902024-11-09T01:33:29.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 67b54e2d-5710-4c01-b41f-50f95e60aba1 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32912024-11-09T01:33:29.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 67b54e2d-5710-4c01-b41f-50f95e60aba1 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
32922024-11-09T01:33:29.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
32932024-11-09T01:33:29.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32942024-11-09T01:33:29.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
32952024-11-09T01:33:29.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32962024-11-09T01:33:29.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32972024-11-09T01:33:29.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32982024-11-09T01:33:29.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32992024-11-09T01:33:29.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33002024-11-09T01:33:29.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33012024-11-09T01:33:29.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33022024-11-09T01:33:29.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33032024-11-09T01:33:29.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33042024-11-09T01:33:29.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33052024-11-09T01:33:29.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
33062024-11-09T01:33:29.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33072024-11-09T01:33:29.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33082024-11-09T01:33:29.106ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
33092024-11-09T01:33:29.106ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.027954ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
33102024-11-09T01:33:29.113ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33112024-11-09T01:33:29.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33122024-11-09T01:33:29.140ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.408476ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33132024-11-09T01:33:29.971ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1598 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = 1c16b664-93af-41cf-a117-fb803e09aed0 response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
33142024-11-09T01:33:30.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d88e924e-7d16-40ca-b369-ad039a7abfc8 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33152024-11-09T01:33:30.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d88e924e-7d16-40ca-b369-ad039a7abfc8 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33162024-11-09T01:33:30.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d88e924e-7d16-40ca-b369-ad039a7abfc8 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33172024-11-09T01:33:31.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 89906602-6356-41e9-b630-fdad016b1bd5 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33182024-11-09T01:33:31.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 89906602-6356-41e9-b630-fdad016b1bd5 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33192024-11-09T01:33:31.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2289 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 89906602-6356-41e9-b630-fdad016b1bd5 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33202024-11-09T01:33:32.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e66056b2-53c5-4f4d-8470-ee056933adbe roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33212024-11-09T01:33:32.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e66056b2-53c5-4f4d-8470-ee056933adbe resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33222024-11-09T01:33:32.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e66056b2-53c5-4f4d-8470-ee056933adbe response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33232024-11-09T01:33:33.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = af3fd6c7-3b74-427b-b02c-76eabb206597 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33242024-11-09T01:33:33.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = af3fd6c7-3b74-427b-b02c-76eabb206597 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33252024-11-09T01:33:33.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = af3fd6c7-3b74-427b-b02c-76eabb206597 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33262024-11-09T01:33:34.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 34cb1c2f-0d53-49fe-8d02-8b451b9c450b roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33272024-11-09T01:33:34.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 34cb1c2f-0d53-49fe-8d02-8b451b9c450b resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33282024-11-09T01:33:34.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 34cb1c2f-0d53-49fe-8d02-8b451b9c450b response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33292024-11-09T01:33:35.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 31e69990-a805-47d7-b394-838835b65b5d roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33302024-11-09T01:33:35.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 31e69990-a805-47d7-b394-838835b65b5d resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33312024-11-09T01:33:35.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2660 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 31e69990-a805-47d7-b394-838835b65b5d response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33322024-11-09T01:33:36.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6974cb1e-8781-49e4-8d63-4c11a3320b03 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33332024-11-09T01:33:36.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6974cb1e-8781-49e4-8d63-4c11a3320b03 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33342024-11-09T01:33:36.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6974cb1e-8781-49e4-8d63-4c11a3320b03 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33352024-11-09T01:33:37.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 01ebd34d-101e-421f-b051-9a6c999187a0 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33362024-11-09T01:33:37.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 01ebd34d-101e-421f-b051-9a6c999187a0 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33372024-11-09T01:33:37.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 01ebd34d-101e-421f-b051-9a6c999187a0 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33382024-11-09T01:33:38.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8ce459f4-f761-4430-9b70-d813263fcbbb roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33392024-11-09T01:33:38.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8ce459f4-f761-4430-9b70-d813263fcbbb resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33402024-11-09T01:33:38.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2588 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8ce459f4-f761-4430-9b70-d813263fcbbb response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
33412024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
33422024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
33432024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
33442024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33452024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33462024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
33472024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
33482024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33492024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
33502024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33512024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
33522024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
33532024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33542024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
33552024-11-09T01:33:39.086ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
33562024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
33572024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33582024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33592024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
33602024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33612024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
33622024-11-09T01:33:39.086ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
33632024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
33642024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33652024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33662024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
33672024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33682024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
33692024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33702024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
33712024-11-09T01:33:39.086ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 01:23:39.086442599 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
33722024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
33732024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
33742024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
33752024-11-09T01:33:39.086ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079
33762024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.49\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079"}
33772024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
33782024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
33792024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
33802024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
33812024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
33822024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
33832024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33842024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
33852024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33862024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
33872024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
33882024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33892024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
33902024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 10.46\u{b5}s iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
33912024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
33922024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
33932024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.17\u{b5}s iteration = 23 status = {"errors":[],"records_set_to_done":[]}
33942024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
33952024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.44\u{b5}s iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
33962024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 3.68\u{b5}s iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
33972024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
33982024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
33992024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
34002024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
34012024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
34022024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34032024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34042024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34052024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34062024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34072024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34082024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34092024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34102024-11-09T01:33:39.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34112024-11-09T01:33:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
34122024-11-09T01:33:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
34132024-11-09T01:33:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34142024-11-09T01:33:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34152024-11-09T01:33:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34162024-11-09T01:33:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34172024-11-09T01:33:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34182024-11-09T01:33:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
34192024-11-09T01:33:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
34202024-11-09T01:33:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34212024-11-09T01:33:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
34222024-11-09T01:33:39.087ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("34219892-cef8-4169-a366-ce17844120f6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("530f76d0-bec9-4ae0-beb0-d217f68ae05a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("530f76d0-bec9-4ae0-beb0-d217f68ae05a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1336, tv_nsec: 107349250 } })
34232024-11-09T01:33:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34242024-11-09T01:33:39.087ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("30d356ab-a881-4ca3-8f43-203be0381a68.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d55caa1f-cc37-4ecb-b8bf-58b9052db1d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d55caa1f-cc37-4ecb-b8bf-58b9052db1d9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1336, tv_nsec: 107408410 } })
34252024-11-09T01:33:39.087ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
34262024-11-09T01:33:39.087ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.172643ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
34272024-11-09T01:33:39.087ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
34282024-11-09T01:33:39.087ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.253094ms iteration = 13 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
34292024-11-09T01:33:39.088ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34302024-11-09T01:33:39.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34312024-11-09T01:33:39.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34322024-11-09T01:33:39.089ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34332024-11-09T01:33:39.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34342024-11-09T01:33:39.090ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.6333ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
34352024-11-09T01:33:39.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34362024-11-09T01:33:39.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34372024-11-09T01:33:39.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34382024-11-09T01:33:39.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34392024-11-09T01:33:39.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34402024-11-09T01:33:39.093ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34412024-11-09T01:33:39.094ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34422024-11-09T01:33:39.094ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34432024-11-09T01:33:39.095ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 01:23:39.086442599 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
34442024-11-09T01:33:39.095ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.015081ms iteration = 12 status = {"expiration":"2024-11-09T01:23:39.086442599Z","pruned":[]}
34452024-11-09T01:33:39.095ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34462024-11-09T01:33:39.095ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34472024-11-09T01:33:39.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34482024-11-09T01:33:39.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
34492024-11-09T01:33:39.096ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34502024-11-09T01:33:39.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34512024-11-09T01:33:39.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34522024-11-09T01:33:39.097ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34532024-11-09T01:33:39.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34542024-11-09T01:33:39.097ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34552024-11-09T01:33:39.098ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34562024-11-09T01:33:39.099ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34572024-11-09T01:33:39.099ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34582024-11-09T01:33:39.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34592024-11-09T01:33:39.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34602024-11-09T01:33:39.100ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1336, tv_nsec: 120657428 } })
34612024-11-09T01:33:39.100ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
34622024-11-09T01:33:39.101ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1336, tv_nsec: 122132854 } })
34632024-11-09T01:33:39.102ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
34642024-11-09T01:33:39.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34652024-11-09T01:33:39.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34662024-11-09T01:33:39.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34672024-11-09T01:33:39.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34682024-11-09T01:33:39.102ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34692024-11-09T01:33:39.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34702024-11-09T01:33:39.104ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.91511ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
34712024-11-09T01:33:39.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34722024-11-09T01:33:39.105ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 19.032303ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34732024-11-09T01:33:39.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34742024-11-09T01:33:39.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34752024-11-09T01:33:39.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34762024-11-09T01:33:39.106ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34772024-11-09T01:33:39.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34782024-11-09T01:33:39.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34792024-11-09T01:33:39.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34802024-11-09T01:33:39.111ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34812024-11-09T01:33:39.112ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34822024-11-09T01:33:39.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34832024-11-09T01:33:39.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34842024-11-09T01:33:39.112ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34852024-11-09T01:33:39.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34862024-11-09T01:33:39.114ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34872024-11-09T01:33:39.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34882024-11-09T01:33:39.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34892024-11-09T01:33:39.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
34902024-11-09T01:33:39.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34912024-11-09T01:33:39.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34922024-11-09T01:33:39.116ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34932024-11-09T01:33:39.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34942024-11-09T01:33:39.120ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34952024-11-09T01:33:39.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34962024-11-09T01:33:39.126ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34972024-11-09T01:33:39.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34982024-11-09T01:33:39.129ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 43.338173ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
34992024-11-09T01:33:39.133ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
35002024-11-09T01:33:39.133ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
35012024-11-09T01:33:39.133ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 46.503629ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
35022024-11-09T01:33:39.137ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35032024-11-09T01:33:39.137ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
35042024-11-09T01:33:39.137ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35052024-11-09T01:33:39.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35062024-11-09T01:33:39.138ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
35072024-11-09T01:33:39.138ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.800008ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
35082024-11-09T01:33:39.144ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35092024-11-09T01:33:39.144ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
35102024-11-09T01:33:39.144ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
35112024-11-09T01:33:39.144ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
35122024-11-09T01:33:39.144ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35132024-11-09T01:33:39.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35142024-11-09T01:33:39.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35152024-11-09T01:33:39.147ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35162024-11-09T01:33:39.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35172024-11-09T01:33:39.148ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35182024-11-09T01:33:39.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35192024-11-09T01:33:39.156ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
35202024-11-09T01:33:39.156ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
35212024-11-09T01:33:39.156ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
35222024-11-09T01:33:39.156ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35232024-11-09T01:33:39.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35242024-11-09T01:33:39.156ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35252024-11-09T01:33:39.158ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
35262024-11-09T01:33:39.158ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
35272024-11-09T01:33:39.158ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 72.020803ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
35282024-11-09T01:33:39.159ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
35292024-11-09T01:33:39.159ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35302024-11-09T01:33:39.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35312024-11-09T01:33:39.162ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35322024-11-09T01:33:39.162ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.064698ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
35332024-11-09T01:33:39.163ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 76.995148ms iteration = 27 status = {"physical_disks_added":0}
35342024-11-09T01:33:39.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
35352024-11-09T01:33:39.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
35362024-11-09T01:33:39.210ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35372024-11-09T01:33:39.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35382024-11-09T01:33:39.211ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
35392024-11-09T01:33:39.252ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
35402024-11-09T01:33:39.252ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35412024-11-09T01:33:39.252ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3780c793-018e-4620-8115-943435ff1bb4", "content-length": "26", "date": "Sat, 09 Nov 2024 01:33:39 GMT"} })
35422024-11-09T01:33:39.252ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35432024-11-09T01:33:39.255ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35442024-11-09T01:33:39.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0d159bbd-7fca-42e7-aa14-a0cf9fa9ea47 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
35452024-11-09T01:33:39.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0d159bbd-7fca-42e7-aa14-a0cf9fa9ea47 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
35462024-11-09T01:33:39.298ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
35472024-11-09T01:33:39.305ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
35482024-11-09T01:33:39.305ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35492024-11-09T01:33:39.306ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e858fe00-2564-45aa-87a3-3ac3deddd22e", "content-length": "372", "date": "Sat, 09 Nov 2024 01:33:39 GMT"} })
35502024-11-09T01:33:39.306ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35512024-11-09T01:33:39.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35522024-11-09T01:33:39.309ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1336, tv_nsec: 330127984 } })
35532024-11-09T01:33:39.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35542024-11-09T01:33:39.310ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
35552024-11-09T01:33:39.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35562024-11-09T01:33:39.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 27675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0d159bbd-7fca-42e7-aa14-a0cf9fa9ea47 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
35572024-11-09T01:33:39.341ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35582024-11-09T01:33:39.343ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35592024-11-09T01:33:39.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35602024-11-09T01:33:39.345ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35612024-11-09T01:33:39.345ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35622024-11-09T01:33:39.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35632024-11-09T01:33:39.345ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35642024-11-09T01:33:39.346ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35652024-11-09T01:33:39.346ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35662024-11-09T01:33:39.346ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35672024-11-09T01:33:39.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35682024-11-09T01:33:39.346ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35692024-11-09T01:33:39.347ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
35702024-11-09T01:33:39.347ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35712024-11-09T01:33:39.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35722024-11-09T01:33:39.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35732024-11-09T01:33:39.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35742024-11-09T01:33:39.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35752024-11-09T01:33:39.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35762024-11-09T01:33:39.351ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
35772024-11-09T01:33:39.351ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35782024-11-09T01:33:39.352ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "51c9e117-fd2e-44a1-91fe-9728d2864eb0", "content-length": "26", "date": "Sat, 09 Nov 2024 01:33:39 GMT"} })
35792024-11-09T01:33:39.352ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35802024-11-09T01:33:39.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c24f6fb-cc5e-4758-a216-4357bbb5d813, lookup_type: ById(8c24f6fb-cc5e-4758-a216-4357bbb5d813) } result = Ok(())
35812024-11-09T01:33:39.353ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35822024-11-09T01:33:39.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35832024-11-09T01:33:39.354ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35842024-11-09T01:33:39.355ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 269.128801ms iteration = 23 status = 0
35852024-11-09T01:33:39.364ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
35862024-11-09T01:33:39.364ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
35872024-11-09T01:33:39.365ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9fe15076-c51c-4d3d-a3e8-d1557f748efd", "date": "Sat, 09 Nov 2024 01:33:39 GMT"} })
35882024-11-09T01:33:39.365ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35892024-11-09T01:33:39.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35902024-11-09T01:33:39.366ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
35912024-11-09T01:33:39.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35922024-11-09T01:33:39.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35932024-11-09T01:33:39.370ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35942024-11-09T01:33:39.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35952024-11-09T01:33:39.374ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
35962024-11-09T01:33:39.374ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35972024-11-09T01:33:39.374ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
35982024-11-09T01:33:39.374ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 72269a3a-73dc-4fb3-8a06-f7b406523664 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
35992024-11-09T01:33:39.374ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36002024-11-09T01:33:39.374ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "45b0e737-5f9a-4619-9054-cde1c492a023", "date": "Sat, 09 Nov 2024 01:33:39 GMT"} })
36012024-11-09T01:33:39.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36022024-11-09T01:33:39.376ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36032024-11-09T01:33:39.377ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 290.614571ms iteration = 24 status = {}
36042024-11-09T01:33:39.377ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
36052024-11-09T01:33:39.377ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 290.931104ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
36062024-11-09T01:33:39.378ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
36072024-11-09T01:33:39.378ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = dadc16e6-e16c-4c3f-bb19-4f189e9d1c26 dns_zone_name = oxide.test found_so_far = 0 version = 2
36082024-11-09T01:33:39.378ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36092024-11-09T01:33:39.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36102024-11-09T01:33:39.380ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36112024-11-09T01:33:39.380ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36122024-11-09T01:33:39.380ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 294.362603ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
36132024-11-09T01:33:39.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36142024-11-09T01:33:39.381ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36152024-11-09T01:33:39.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36162024-11-09T01:33:39.383ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 72269a3a-73dc-4fb3-8a06-f7b406523664 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
36172024-11-09T01:33:39.383ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
36182024-11-09T01:33:39.383ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 01:23:03.098267 UTC dns_group = internal generation = 1
36192024-11-09T01:33:39.383ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 297.470287ms iteration = 13 status = {"generation":1}
36202024-11-09T01:33:39.393ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T01:22:35.233443Z, time_modified: 2024-11-09T01:22:35.233443Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 539ccef2-8207-42b1-9e05-00e0a1387c35, db_silo: Silo { identity: SiloIdentity { id: 539ccef2-8207-42b1-9e05-00e0a1387c35, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T01:23:03.926223Z, time_modified: 2024-11-09T01:23:03.926223Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 539ccef2-8207-42b1-9e05-00e0a1387c35, db_silo: Silo { identity: SiloIdentity { id: 539ccef2-8207-42b1-9e05-00e0a1387c35, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T01:23:03.926223Z, time_modified: 2024-11-09T01:23:03.926223Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248" }] }) }
36212024-11-09T01:33:39.393ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 306.780211ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"539ccef2-8207-42b1-9e05-00e0a1387c35","tls_certs":["22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248"]}},"default_endpoint":{"silo_id":"539ccef2-8207-42b1-9e05-00e0a1387c35","tls_certs":["22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
36222024-11-09T01:33:39.416ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36232024-11-09T01:33:39.417ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36242024-11-09T01:33:39.417ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "88f1e1ae-a49f-446c-9f09-2fc08ba8cc2c", "content-length": "1", "date": "Sat, 09 Nov 2024 01:33:39 GMT"} })
36252024-11-09T01:33:39.417ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36262024-11-09T01:33:39.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36272024-11-09T01:33:39.419ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36282024-11-09T01:33:39.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36292024-11-09T01:33:39.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36302024-11-09T01:33:39.419ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36312024-11-09T01:33:39.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36322024-11-09T01:33:39.419ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36332024-11-09T01:33:39.421ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = dadc16e6-e16c-4c3f-bb19-4f189e9d1c26 dns_zone_name = oxide.test found_so_far = 1 version = 2
36342024-11-09T01:33:39.421ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
36352024-11-09T01:33:39.421ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 01:23:03.974860 UTC dns_group = external generation = 2
36362024-11-09T01:33:39.421ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 334.973355ms iteration = 13 status = {"generation":2}
36372024-11-09T01:33:39.421ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36382024-11-09T01:33:39.421ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36392024-11-09T01:33:39.421ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 335.42762ms iteration = 23 status = null
36402024-11-09T01:33:39.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36412024-11-09T01:33:39.436ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba zone_address = fd00:1122:3344:101::2
36422024-11-09T01:33:39.436ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36432024-11-09T01:33:39.436ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "049971a5-d8b2-48a1-8c2f-7185d8f280b9", "content-length": "26", "date": "Sat, 09 Nov 2024 01:33:39 GMT"} })
36442024-11-09T01:33:39.436ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36452024-11-09T01:33:39.438ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
36462024-11-09T01:33:39.445ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
36472024-11-09T01:33:39.445ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ccdbba1b-420c-47fa-9015-4fd240f989e4", "date": "Sat, 09 Nov 2024 01:33:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36482024-11-09T01:33:39.445ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36492024-11-09T01:33:39.447ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "20af400e-e69c-447a-926b-13038182dc87", "date": "Sat, 09 Nov 2024 01:33:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36502024-11-09T01:33:39.447ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36512024-11-09T01:33:39.447ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36522024-11-09T01:33:39.449ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36532024-11-09T01:33:39.449ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36542024-11-09T01:33:39.449ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36552024-11-09T01:33:39.449ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 363.090539ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
36562024-11-09T01:33:39.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36572024-11-09T01:33:39.467ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 381.19687ms iteration = 23 status = {}
36582024-11-09T01:33:39.474ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
36592024-11-09T01:33:39.474ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4b7eb4a7-07bf-4d47-b470-dd7c9a9b80bd", "date": "Sat, 09 Nov 2024 01:33:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36602024-11-09T01:33:39.474ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36612024-11-09T01:33:39.477ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4e920ccf-11ae-4c93-8593-1cb21a24af41", "date": "Sat, 09 Nov 2024 01:33:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36622024-11-09T01:33:39.477ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36632024-11-09T01:33:39.478ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0306e66c-8cdf-4014-95bf-c934156827b5", "date": "Sat, 09 Nov 2024 01:33:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36642024-11-09T01:33:39.478ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36652024-11-09T01:33:39.480ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36662024-11-09T01:33:39.480ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 394.345457ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
36672024-11-09T01:33:39.523ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
36682024-11-09T01:33:39.523ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "88771418-38b0-42d1-83d9-52717fe7d9d3", "content-length": "691", "date": "Sat, 09 Nov 2024 01:33:39 GMT"} })
36692024-11-09T01:33:39.523ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
36702024-11-09T01:33:39.523ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
36712024-11-09T01:33:39.523ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
36722024-11-09T01:33:39.525ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 439.245688ms iteration = 23 status = {}
36732024-11-09T01:33:39.599ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36742024-11-09T01:33:39.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36752024-11-09T01:33:39.602ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 68cb9c64-43d4-4c3f-ba7b-013513b8c68d, rack_id: 54080907-d4a8-4f65-b867-da4e2da6d2ba, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8166ae85-b9fa-427c-9f22-e997378e0527) } rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
36762024-11-09T01:33:39.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36772024-11-09T01:33:39.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36782024-11-09T01:33:39.613ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
36792024-11-09T01:33:39.613ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fa5d239-83dd-492a-9e44-dad9e979013f", "content-length": "134", "date": "Sat, 09 Nov 2024 01:33:39 GMT"} })
36802024-11-09T01:33:39.613ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
36812024-11-09T01:33:39.613ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8166ae85-b9fa-427c-9f22-e997378e0527
36822024-11-09T01:33:39.613ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
36832024-11-09T01:33:39.613ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36842024-11-09T01:33:39.613ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36852024-11-09T01:33:39.613ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36862024-11-09T01:33:39.613ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36872024-11-09T01:33:39.613ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36882024-11-09T01:33:39.614ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36892024-11-09T01:33:39.614ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36902024-11-09T01:33:39.614ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
36912024-11-09T01:33:39.614ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36922024-11-09T01:33:39.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36932024-11-09T01:33:39.616ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
36942024-11-09T01:33:39.617ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f832ca4-ab14-4856-97a4-720188cb8cc6", "content-length": "2", "date": "Sat, 09 Nov 2024 01:33:39 GMT"} })
36952024-11-09T01:33:39.617ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
36962024-11-09T01:33:39.617ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c44608b4-728e-428a-8dd9-c7a668f4eea2", "content-length": "52", "date": "Sat, 09 Nov 2024 01:33:39 GMT"} })
36972024-11-09T01:33:39.617ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
36982024-11-09T01:33:39.617ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
36992024-11-09T01:33:39.739ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d1763b97-ef8c-485c-b7d0-3e7db69efae4", "date": "Sat, 09 Nov 2024 01:33:39 GMT"} })
37002024-11-09T01:33:39.739ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch = Switch0
37012024-11-09T01:33:39.739ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37022024-11-09T01:33:39.739ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ca3d1f1-b12b-4d7d-bf07-1243f3c5f78c", "content-length": "682", "date": "Sat, 09 Nov 2024 01:33:39 GMT"} })
37032024-11-09T01:33:39.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37042024-11-09T01:33:39.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37052024-11-09T01:33:39.744ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37062024-11-09T01:33:39.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37072024-11-09T01:33:39.748ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37082024-11-09T01:33:39.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37092024-11-09T01:33:39.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37102024-11-09T01:33:39.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37112024-11-09T01:33:39.757ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 671.191424ms iteration = 23 status = {}
37122024-11-09T01:33:40.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 402cf19e-fc57-465a-890e-e00c04a982dd roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37132024-11-09T01:33:40.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 402cf19e-fc57-465a-890e-e00c04a982dd resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37142024-11-09T01:33:40.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2739 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 402cf19e-fc57-465a-890e-e00c04a982dd response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37152024-11-09T01:33:40.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 98814168-0643-445a-ac3d-800cdd7e3f5e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
37162024-11-09T01:33:40.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 98814168-0643-445a-ac3d-800cdd7e3f5e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
37172024-11-09T01:33:40.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3642 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 98814168-0643-445a-ac3d-800cdd7e3f5e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
37182024-11-09T01:33:41.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7249c08e-8c32-4c56-9026-e2b2cc55f6ee roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37192024-11-09T01:33:41.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7249c08e-8c32-4c56-9026-e2b2cc55f6ee resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37202024-11-09T01:33:41.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2711 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7249c08e-8c32-4c56-9026-e2b2cc55f6ee response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37212024-11-09T01:33:42.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f0fabf10-f93f-43da-8193-f043de52d996 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37222024-11-09T01:33:42.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f0fabf10-f93f-43da-8193-f043de52d996 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37232024-11-09T01:33:42.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2700 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f0fabf10-f93f-43da-8193-f043de52d996 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37242024-11-09T01:33:43.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f4ce3790-1bbc-42cd-81b7-91cc33618e48 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37252024-11-09T01:33:43.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f4ce3790-1bbc-42cd-81b7-91cc33618e48 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37262024-11-09T01:33:43.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2657 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f4ce3790-1bbc-42cd-81b7-91cc33618e48 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37272024-11-09T01:33:44.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c0a2280e-74f8-4c40-9202-bd2495136e2f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37282024-11-09T01:33:44.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c0a2280e-74f8-4c40-9202-bd2495136e2f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37292024-11-09T01:33:44.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c0a2280e-74f8-4c40-9202-bd2495136e2f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37302024-11-09T01:33:44.971ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1955 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = bfce763b-da54-406b-8068-bd230ec4b098 response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
37312024-11-09T01:33:45.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 66eec4bb-d91c-422e-a2ab-6d818948c182 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37322024-11-09T01:33:45.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 66eec4bb-d91c-422e-a2ab-6d818948c182 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37332024-11-09T01:33:45.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 66eec4bb-d91c-422e-a2ab-6d818948c182 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37342024-11-09T01:33:46.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = caaee015-08bb-454e-97be-b6f6bcaa09c1 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37352024-11-09T01:33:46.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = caaee015-08bb-454e-97be-b6f6bcaa09c1 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37362024-11-09T01:33:46.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = caaee015-08bb-454e-97be-b6f6bcaa09c1 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37372024-11-09T01:33:47.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8dfcfc7a-5b22-4cb6-baaa-78b960b4c90a roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37382024-11-09T01:33:47.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8dfcfc7a-5b22-4cb6-baaa-78b960b4c90a resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37392024-11-09T01:33:47.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2192 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8dfcfc7a-5b22-4cb6-baaa-78b960b4c90a response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37402024-11-09T01:33:48.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b0a2d51e-a3a0-4ca2-b937-486de08436a1 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37412024-11-09T01:33:48.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b0a2d51e-a3a0-4ca2-b937-486de08436a1 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37422024-11-09T01:33:48.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b0a2d51e-a3a0-4ca2-b937-486de08436a1 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37432024-11-09T01:33:49.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
37442024-11-09T01:33:49.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37452024-11-09T01:33:49.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
37462024-11-09T01:33:49.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37472024-11-09T01:33:49.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37482024-11-09T01:33:49.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37492024-11-09T01:33:49.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37502024-11-09T01:33:49.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37512024-11-09T01:33:49.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37522024-11-09T01:33:49.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37532024-11-09T01:33:49.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37542024-11-09T01:33:49.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37552024-11-09T01:33:49.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37562024-11-09T01:33:49.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
37572024-11-09T01:33:49.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37582024-11-09T01:33:49.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37592024-11-09T01:33:49.110ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
37602024-11-09T01:33:49.110ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.090608ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
37612024-11-09T01:33:49.115ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37622024-11-09T01:33:49.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37632024-11-09T01:33:49.143ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.126787ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37642024-11-09T01:33:49.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 701b9424-c8a6-44bf-9bf4-612ac3be2715 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37652024-11-09T01:33:49.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 701b9424-c8a6-44bf-9bf4-612ac3be2715 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37662024-11-09T01:33:49.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 701b9424-c8a6-44bf-9bf4-612ac3be2715 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37672024-11-09T01:33:49.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 58655373-7cdc-458a-be13-dc38c5e94894 roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
37682024-11-09T01:33:49.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 58655373-7cdc-458a-be13-dc38c5e94894 resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
37692024-11-09T01:33:49.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2671 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 58655373-7cdc-458a-be13-dc38c5e94894 response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
37702024-11-09T01:33:49.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = cf7f0888-6778-41c0-a090-c1aac734f5da roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
37712024-11-09T01:33:49.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = cf7f0888-6778-41c0-a090-c1aac734f5da resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
37722024-11-09T01:33:49.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = cf7f0888-6778-41c0-a090-c1aac734f5da response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
37732024-11-09T01:33:50.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 846a438d-94a3-48fc-aada-5d7c60770ab3 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37742024-11-09T01:33:50.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 846a438d-94a3-48fc-aada-5d7c60770ab3 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37752024-11-09T01:33:50.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1842 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 846a438d-94a3-48fc-aada-5d7c60770ab3 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37762024-11-09T01:33:51.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d91d77e0-a8bf-453a-8d72-edb6958d0464 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37772024-11-09T01:33:51.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d91d77e0-a8bf-453a-8d72-edb6958d0464 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37782024-11-09T01:33:51.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d91d77e0-a8bf-453a-8d72-edb6958d0464 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37792024-11-09T01:33:52.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6d9dac5a-de8c-4936-ab67-aa36135ed3d5 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37802024-11-09T01:33:52.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6d9dac5a-de8c-4936-ab67-aa36135ed3d5 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37812024-11-09T01:33:52.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1905 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6d9dac5a-de8c-4936-ab67-aa36135ed3d5 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37822024-11-09T01:33:53.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6df3b9a5-d26e-414f-97f2-3e9659cf7f1b roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37832024-11-09T01:33:53.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6df3b9a5-d26e-414f-97f2-3e9659cf7f1b resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37842024-11-09T01:33:53.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6df3b9a5-d26e-414f-97f2-3e9659cf7f1b response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37852024-11-09T01:33:54.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6ea3a1fd-cd11-4968-8f0d-a860f0ebfcc1 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37862024-11-09T01:33:54.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6ea3a1fd-cd11-4968-8f0d-a860f0ebfcc1 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37872024-11-09T01:33:54.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1998 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6ea3a1fd-cd11-4968-8f0d-a860f0ebfcc1 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37882024-11-09T01:33:55.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 39e8a204-4ce3-40e9-96dd-d7811b1a11d1 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37892024-11-09T01:33:55.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 39e8a204-4ce3-40e9-96dd-d7811b1a11d1 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37902024-11-09T01:33:55.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2492 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 39e8a204-4ce3-40e9-96dd-d7811b1a11d1 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37912024-11-09T01:33:56.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 84e19ca4-6164-4d30-aceb-dcb255cf790e roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37922024-11-09T01:33:56.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 84e19ca4-6164-4d30-aceb-dcb255cf790e resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37932024-11-09T01:33:56.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 84e19ca4-6164-4d30-aceb-dcb255cf790e response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37942024-11-09T01:33:57.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4a4a798f-8131-4df8-839c-48a5645b5b6b roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37952024-11-09T01:33:57.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4a4a798f-8131-4df8-839c-48a5645b5b6b resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37962024-11-09T01:33:57.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4a4a798f-8131-4df8-839c-48a5645b5b6b response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37972024-11-09T01:33:58.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0feb9792-acb9-4e51-b16f-15f7383b774e roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37982024-11-09T01:33:58.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0feb9792-acb9-4e51-b16f-15f7383b774e resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
37992024-11-09T01:33:58.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0feb9792-acb9-4e51-b16f-15f7383b774e response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38002024-11-09T01:33:59.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
38012024-11-09T01:33:59.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
38022024-11-09T01:33:59.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38032024-11-09T01:33:59.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38042024-11-09T01:33:59.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38052024-11-09T01:33:59.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38062024-11-09T01:33:59.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38072024-11-09T01:33:59.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38082024-11-09T01:33:59.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38092024-11-09T01:33:59.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38102024-11-09T01:33:59.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38112024-11-09T01:33:59.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38122024-11-09T01:33:59.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38132024-11-09T01:33:59.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
38142024-11-09T01:33:59.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38152024-11-09T01:33:59.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38162024-11-09T01:33:59.106ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
38172024-11-09T01:33:59.106ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.189985ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
38182024-11-09T01:33:59.115ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38192024-11-09T01:33:59.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38202024-11-09T01:33:59.142ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.580321ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38212024-11-09T01:33:59.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = aecec976-c197-407a-9eb2-88ad5b014ed0 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38222024-11-09T01:33:59.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = aecec976-c197-407a-9eb2-88ad5b014ed0 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38232024-11-09T01:33:59.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = aecec976-c197-407a-9eb2-88ad5b014ed0 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38242024-11-09T01:33:59.971ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1675 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = 0db92038-d043-4ced-8500-b441ca43436d response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
38252024-11-09T01:34:00.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 399ceff6-c3ac-4c0f-a4b4-26955b53edc3 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38262024-11-09T01:34:00.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 399ceff6-c3ac-4c0f-a4b4-26955b53edc3 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38272024-11-09T01:34:00.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1983 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 399ceff6-c3ac-4c0f-a4b4-26955b53edc3 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38282024-11-09T01:34:01.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3f62de0b-4d52-498a-b538-7b1e50ad82be roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38292024-11-09T01:34:01.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3f62de0b-4d52-498a-b538-7b1e50ad82be resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38302024-11-09T01:34:01.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2014 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3f62de0b-4d52-498a-b538-7b1e50ad82be response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38312024-11-09T01:34:02.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = fee442bf-d424-495b-8936-e5b6644c30e3 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38322024-11-09T01:34:02.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = fee442bf-d424-495b-8936-e5b6644c30e3 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38332024-11-09T01:34:02.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2040 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = fee442bf-d424-495b-8936-e5b6644c30e3 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38342024-11-09T01:34:03.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 08d6b801-20c6-46ca-b0b1-7a03d5847840 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38352024-11-09T01:34:03.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 08d6b801-20c6-46ca-b0b1-7a03d5847840 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38362024-11-09T01:34:03.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 08d6b801-20c6-46ca-b0b1-7a03d5847840 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38372024-11-09T01:34:04.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3f17e455-3b96-4305-97f5-a7dbf65ca6c8 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38382024-11-09T01:34:04.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3f17e455-3b96-4305-97f5-a7dbf65ca6c8 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38392024-11-09T01:34:04.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2055 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3f17e455-3b96-4305-97f5-a7dbf65ca6c8 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38402024-11-09T01:34:04.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = f78a5640-5d79-4038-a35f-d7cf6547e596 roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
38412024-11-09T01:34:04.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = f78a5640-5d79-4038-a35f-d7cf6547e596 resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
38422024-11-09T01:34:04.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3341 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = f78a5640-5d79-4038-a35f-d7cf6547e596 response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
38432024-11-09T01:34:04.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = d346a2cd-0387-4761-978c-0357a187f06b roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
38442024-11-09T01:34:04.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = d346a2cd-0387-4761-978c-0357a187f06b resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
38452024-11-09T01:34:04.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2646 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = d346a2cd-0387-4761-978c-0357a187f06b response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
38462024-11-09T01:34:05.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b4216d75-f9f4-4254-80f1-5594f48ef591 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38472024-11-09T01:34:05.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b4216d75-f9f4-4254-80f1-5594f48ef591 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38482024-11-09T01:34:05.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b4216d75-f9f4-4254-80f1-5594f48ef591 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38492024-11-09T01:34:06.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 91cb55b3-c5b8-4a0b-be92-6bdeb165f8cd roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38502024-11-09T01:34:06.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 91cb55b3-c5b8-4a0b-be92-6bdeb165f8cd resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38512024-11-09T01:34:06.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1865 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 91cb55b3-c5b8-4a0b-be92-6bdeb165f8cd response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38522024-11-09T01:34:07.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7ba689cf-3fe4-4886-938d-8853d586cc53 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38532024-11-09T01:34:07.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7ba689cf-3fe4-4886-938d-8853d586cc53 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38542024-11-09T01:34:07.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7ba689cf-3fe4-4886-938d-8853d586cc53 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38552024-11-09T01:34:09.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0dd6dd08-d498-4071-a55a-0f4e0c8964d7 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38562024-11-09T01:34:09.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0dd6dd08-d498-4071-a55a-0f4e0c8964d7 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38572024-11-09T01:34:09.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0dd6dd08-d498-4071-a55a-0f4e0c8964d7 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
38582024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
38592024-11-09T01:34:09.086ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
38602024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
38612024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
38622024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38632024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38642024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38652024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
38662024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38672024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
38682024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38692024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
38702024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38712024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
38722024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38732024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
38742024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
38752024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38762024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
38772024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38782024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38792024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
38802024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
38812024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38822024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
38832024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38842024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38852024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38862024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38872024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38882024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38892024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38902024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38912024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38922024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38932024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38942024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38952024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38962024-11-09T01:34:09.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38972024-11-09T01:34:09.087ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
38982024-11-09T01:34:09.087ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
38992024-11-09T01:34:09.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 13.94\u{b5}s iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
39002024-11-09T01:34:09.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.16\u{b5}s iteration = 24 status = {"errors":[],"records_set_to_done":[]}
39012024-11-09T01:34:09.087ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
39022024-11-09T01:34:09.087ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
39032024-11-09T01:34:09.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.73\u{b5}s iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
39042024-11-09T01:34:09.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 9.56\u{b5}s iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
39052024-11-09T01:34:09.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39062024-11-09T01:34:09.089ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39072024-11-09T01:34:09.089ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.977164ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39082024-11-09T01:34:09.091ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39092024-11-09T01:34:09.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39102024-11-09T01:34:09.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39112024-11-09T01:34:09.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39122024-11-09T01:34:09.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39132024-11-09T01:34:09.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39142024-11-09T01:34:09.094ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39152024-11-09T01:34:09.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39162024-11-09T01:34:09.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39172024-11-09T01:34:09.094ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1366, tv_nsec: 114961995 } })
39182024-11-09T01:34:09.095ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
39192024-11-09T01:34:09.096ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1366, tv_nsec: 116121408 } })
39202024-11-09T01:34:09.096ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
39212024-11-09T01:34:09.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39222024-11-09T01:34:09.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39232024-11-09T01:34:09.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39242024-11-09T01:34:09.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39252024-11-09T01:34:09.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39262024-11-09T01:34:09.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39272024-11-09T01:34:09.100ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1366, tv_nsec: 120716649 } })
39282024-11-09T01:34:09.100ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
39292024-11-09T01:34:09.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
39302024-11-09T01:34:09.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39312024-11-09T01:34:09.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39322024-11-09T01:34:09.123ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
39332024-11-09T01:34:09.123ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 37.864512ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
39342024-11-09T01:34:09.126ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39352024-11-09T01:34:09.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39362024-11-09T01:34:09.127ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39372024-11-09T01:34:09.128ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 42.575934ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39382024-11-09T01:34:09.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39392024-11-09T01:34:09.130ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39402024-11-09T01:34:09.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39412024-11-09T01:34:09.130ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39422024-11-09T01:34:09.131ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39432024-11-09T01:34:09.132ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39442024-11-09T01:34:09.132ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39452024-11-09T01:34:09.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39462024-11-09T01:34:09.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39472024-11-09T01:34:09.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39482024-11-09T01:34:09.134ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39492024-11-09T01:34:09.134ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39502024-11-09T01:34:09.134ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39512024-11-09T01:34:09.134ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39522024-11-09T01:34:09.134ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39532024-11-09T01:34:09.134ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39542024-11-09T01:34:09.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39552024-11-09T01:34:09.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39562024-11-09T01:34:09.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39572024-11-09T01:34:09.136ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39582024-11-09T01:34:09.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39592024-11-09T01:34:09.137ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39602024-11-09T01:34:09.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39612024-11-09T01:34:09.138ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39622024-11-09T01:34:09.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39632024-11-09T01:34:09.141ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.843872ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39642024-11-09T01:34:09.162ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39652024-11-09T01:34:09.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39662024-11-09T01:34:09.166ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39672024-11-09T01:34:09.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39682024-11-09T01:34:09.167ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39692024-11-09T01:34:09.170ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c24f6fb-cc5e-4758-a216-4357bbb5d813, lookup_type: ById(8c24f6fb-cc5e-4758-a216-4357bbb5d813) } result = Ok(())
39702024-11-09T01:34:09.170ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39712024-11-09T01:34:09.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39722024-11-09T01:34:09.172ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 86.546425ms iteration = 24 status = 0
39732024-11-09T01:34:09.173ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39742024-11-09T01:34:09.173ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39752024-11-09T01:34:09.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39762024-11-09T01:34:09.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39772024-11-09T01:34:09.174ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
39782024-11-09T01:34:09.174ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39792024-11-09T01:34:09.174ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "813d11e8-775d-4498-ae37-381e30720cc5", "content-length": "26", "date": "Sat, 09 Nov 2024 01:34:09 GMT"} })
39802024-11-09T01:34:09.174ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39812024-11-09T01:34:09.175ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39822024-11-09T01:34:09.179ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39832024-11-09T01:34:09.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39842024-11-09T01:34:09.181ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39852024-11-09T01:34:09.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39862024-11-09T01:34:09.182ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
39872024-11-09T01:34:09.182ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39882024-11-09T01:34:09.183ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ca424d4-41cf-4741-8b8f-35cd11e2ba5f", "content-length": "26", "date": "Sat, 09 Nov 2024 01:34:09 GMT"} })
39892024-11-09T01:34:09.183ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39902024-11-09T01:34:09.184ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39912024-11-09T01:34:09.186ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba zone_address = fd00:1122:3344:101::2
39922024-11-09T01:34:09.186ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39932024-11-09T01:34:09.186ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1823cab-3d96-4eb8-a968-27899529b21b", "content-length": "26", "date": "Sat, 09 Nov 2024 01:34:09 GMT"} })
39942024-11-09T01:34:09.186ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39952024-11-09T01:34:09.188ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
39962024-11-09T01:34:09.190ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
39972024-11-09T01:34:09.190ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 103.902348ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
39982024-11-09T01:34:09.208ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39992024-11-09T01:34:09.208ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40002024-11-09T01:34:09.208ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.792189ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
40012024-11-09T01:34:09.239ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40022024-11-09T01:34:09.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40032024-11-09T01:34:09.241ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40042024-11-09T01:34:09.243ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40052024-11-09T01:34:09.243ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40062024-11-09T01:34:09.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40072024-11-09T01:34:09.253ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40082024-11-09T01:34:09.253ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "61245160-1494-4c41-bf8a-85ae83cf251a", "content-length": "1", "date": "Sat, 09 Nov 2024 01:34:08 GMT"} })
40092024-11-09T01:34:09.255ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40102024-11-09T01:34:09.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40112024-11-09T01:34:09.266ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 180.622094ms iteration = 24 status = {}
40122024-11-09T01:34:09.276ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
40132024-11-09T01:34:09.276ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40142024-11-09T01:34:09.276ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "895d291a-ffc3-4e58-a6ed-27eac400a66d", "content-length": "372", "date": "Sat, 09 Nov 2024 01:34:09 GMT"} })
40152024-11-09T01:34:09.276ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40162024-11-09T01:34:09.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40172024-11-09T01:34:09.277ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 191.347734ms iteration = 28 status = {"physical_disks_added":0}
40182024-11-09T01:34:09.278ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 192.278204ms iteration = 24 status = null
40192024-11-09T01:34:09.305ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40202024-11-09T01:34:09.307ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40212024-11-09T01:34:09.307ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40222024-11-09T01:34:09.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40232024-11-09T01:34:09.317ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
40242024-11-09T01:34:09.317ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
40252024-11-09T01:34:09.317ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "99426d16-b037-4111-95e9-d0369285170b", "date": "Sat, 09 Nov 2024 01:34:09 GMT"} })
40262024-11-09T01:34:09.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40272024-11-09T01:34:09.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40282024-11-09T01:34:09.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40292024-11-09T01:34:09.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40302024-11-09T01:34:09.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40312024-11-09T01:34:09.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40322024-11-09T01:34:09.326ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
40332024-11-09T01:34:09.326ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40342024-11-09T01:34:09.326ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "00408e59-33f6-4d51-89fb-c0386e2d902e", "date": "Sat, 09 Nov 2024 01:34:09 GMT"} })
40352024-11-09T01:34:09.327ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 241.775596ms iteration = 25 status = {}
40362024-11-09T01:34:09.421ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40372024-11-09T01:34:09.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40382024-11-09T01:34:09.423ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
40392024-11-09T01:34:09.424ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f73b1846-1e4f-474d-8932-dbc65e7d6147", "content-length": "691", "date": "Sat, 09 Nov 2024 01:34:09 GMT"} })
40402024-11-09T01:34:09.424ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
40412024-11-09T01:34:09.424ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
40422024-11-09T01:34:09.424ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
40432024-11-09T01:34:09.425ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 339.480535ms iteration = 24 status = {}
40442024-11-09T01:34:09.425ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 68cb9c64-43d4-4c3f-ba7b-013513b8c68d, rack_id: 54080907-d4a8-4f65-b867-da4e2da6d2ba, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8166ae85-b9fa-427c-9f22-e997378e0527) } rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
40452024-11-09T01:34:09.425ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40462024-11-09T01:34:09.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40472024-11-09T01:34:09.435ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
40482024-11-09T01:34:09.435ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7da9cea-5758-4e9c-8763-839675873d42", "content-length": "134", "date": "Sat, 09 Nov 2024 01:34:09 GMT"} })
40492024-11-09T01:34:09.435ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
40502024-11-09T01:34:09.435ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8166ae85-b9fa-427c-9f22-e997378e0527
40512024-11-09T01:34:09.436ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
40522024-11-09T01:34:09.436ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
40532024-11-09T01:34:09.436ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40542024-11-09T01:34:09.436ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40552024-11-09T01:34:09.436ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40562024-11-09T01:34:09.436ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40572024-11-09T01:34:09.436ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40582024-11-09T01:34:09.436ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40592024-11-09T01:34:09.436ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
40602024-11-09T01:34:09.436ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40612024-11-09T01:34:09.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40622024-11-09T01:34:09.438ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
40632024-11-09T01:34:09.438ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5463b5f8-d90b-46a0-a6b6-6615a5ac565d", "content-length": "2", "date": "Sat, 09 Nov 2024 01:34:09 GMT"} })
40642024-11-09T01:34:09.438ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
40652024-11-09T01:34:09.439ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8212a5f0-0669-4481-821c-569d0c638463", "content-length": "52", "date": "Sat, 09 Nov 2024 01:34:09 GMT"} })
40662024-11-09T01:34:09.439ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
40672024-11-09T01:34:09.439ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
40682024-11-09T01:34:09.555ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "085ac0fa-4d32-4c6f-92f8-1b34caf8d53d", "date": "Sat, 09 Nov 2024 01:34:09 GMT"} })
40692024-11-09T01:34:09.555ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch = Switch0
40702024-11-09T01:34:09.555ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
40712024-11-09T01:34:09.555ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed1b36a8-fb05-40c6-8ea1-302d0e319bbc", "content-length": "682", "date": "Sat, 09 Nov 2024 01:34:09 GMT"} })
40722024-11-09T01:34:09.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40732024-11-09T01:34:09.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40742024-11-09T01:34:09.559ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40752024-11-09T01:34:09.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40762024-11-09T01:34:09.563ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40772024-11-09T01:34:09.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40782024-11-09T01:34:09.565ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40792024-11-09T01:34:09.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40802024-11-09T01:34:09.575ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 489.458547ms iteration = 24 status = {}
40812024-11-09T01:34:10.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 21594b9d-5d54-4272-84c2-5e872603c71c roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
40822024-11-09T01:34:10.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 21594b9d-5d54-4272-84c2-5e872603c71c resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
40832024-11-09T01:34:10.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 21594b9d-5d54-4272-84c2-5e872603c71c response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
40842024-11-09T01:34:10.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 19c1d75a-3d8c-4790-b29a-2c2947188312 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
40852024-11-09T01:34:10.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 19c1d75a-3d8c-4790-b29a-2c2947188312 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
40862024-11-09T01:34:10.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2788 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 19c1d75a-3d8c-4790-b29a-2c2947188312 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
40872024-11-09T01:34:11.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a6b867d0-9d84-4f89-af51-6a7a856503d2 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
40882024-11-09T01:34:11.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a6b867d0-9d84-4f89-af51-6a7a856503d2 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
40892024-11-09T01:34:11.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a6b867d0-9d84-4f89-af51-6a7a856503d2 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
40902024-11-09T01:34:12.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 191307d4-954d-46a0-87b8-4b4f3a58d120 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
40912024-11-09T01:34:12.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 191307d4-954d-46a0-87b8-4b4f3a58d120 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
40922024-11-09T01:34:12.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2471 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 191307d4-954d-46a0-87b8-4b4f3a58d120 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
40932024-11-09T01:34:13.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 526e9538-1904-4587-8990-36332a17918c roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
40942024-11-09T01:34:13.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 526e9538-1904-4587-8990-36332a17918c resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
40952024-11-09T01:34:13.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2368 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 526e9538-1904-4587-8990-36332a17918c response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
40962024-11-09T01:34:14.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 07d3de95-dffa-4518-9495-dcaf9ae86c9d roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
40972024-11-09T01:34:14.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 07d3de95-dffa-4518-9495-dcaf9ae86c9d resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
40982024-11-09T01:34:14.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 07d3de95-dffa-4518-9495-dcaf9ae86c9d response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
40992024-11-09T01:34:14.972ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1632 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = 26810ec0-583c-46b0-ac9c-c6ebe3e1823f response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
41002024-11-09T01:34:15.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 87aa7869-ab65-4a49-ac9d-ce24dd178e28 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41012024-11-09T01:34:15.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 87aa7869-ab65-4a49-ac9d-ce24dd178e28 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41022024-11-09T01:34:15.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2879 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 87aa7869-ab65-4a49-ac9d-ce24dd178e28 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41032024-11-09T01:34:16.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4e0d0426-727f-4f18-8c36-3da805a5a51d roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41042024-11-09T01:34:16.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4e0d0426-727f-4f18-8c36-3da805a5a51d resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41052024-11-09T01:34:16.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4e0d0426-727f-4f18-8c36-3da805a5a51d response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41062024-11-09T01:34:17.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f5bd5095-85d8-48b5-bcb8-889bd86d6132 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41072024-11-09T01:34:17.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f5bd5095-85d8-48b5-bcb8-889bd86d6132 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41082024-11-09T01:34:17.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f5bd5095-85d8-48b5-bcb8-889bd86d6132 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41092024-11-09T01:34:18.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e53402a3-8f81-48e4-8ce3-961c8d2e417f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41102024-11-09T01:34:18.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e53402a3-8f81-48e4-8ce3-961c8d2e417f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41112024-11-09T01:34:18.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1615 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e53402a3-8f81-48e4-8ce3-961c8d2e417f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41122024-11-09T01:34:19.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
41132024-11-09T01:34:19.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41142024-11-09T01:34:19.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
41152024-11-09T01:34:19.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41162024-11-09T01:34:19.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41172024-11-09T01:34:19.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41182024-11-09T01:34:19.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41192024-11-09T01:34:19.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41202024-11-09T01:34:19.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41212024-11-09T01:34:19.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41222024-11-09T01:34:19.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41232024-11-09T01:34:19.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41242024-11-09T01:34:19.117ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41252024-11-09T01:34:19.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41262024-11-09T01:34:19.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41272024-11-09T01:34:19.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
41282024-11-09T01:34:19.129ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41292024-11-09T01:34:19.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41302024-11-09T01:34:19.140ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
41312024-11-09T01:34:19.140ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.431347ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
41322024-11-09T01:34:19.145ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.361822ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41332024-11-09T01:34:19.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7f4d94f4-bdaa-4ae4-8ad1-598fd6a9ebb7 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41342024-11-09T01:34:19.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7f4d94f4-bdaa-4ae4-8ad1-598fd6a9ebb7 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41352024-11-09T01:34:19.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1812 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7f4d94f4-bdaa-4ae4-8ad1-598fd6a9ebb7 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41362024-11-09T01:34:20.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8178320b-999e-4472-9988-32d17376a176 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41372024-11-09T01:34:20.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8178320b-999e-4472-9988-32d17376a176 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41382024-11-09T01:34:20.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2311 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8178320b-999e-4472-9988-32d17376a176 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41392024-11-09T01:34:21.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 87b2a7a3-f9be-45ec-8b92-a6f4108da4dc roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41402024-11-09T01:34:21.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 87b2a7a3-f9be-45ec-8b92-a6f4108da4dc resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41412024-11-09T01:34:21.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2640 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 87b2a7a3-f9be-45ec-8b92-a6f4108da4dc response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41422024-11-09T01:34:22.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 22cf9d69-03f4-4551-8032-784b49f29979 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41432024-11-09T01:34:22.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 22cf9d69-03f4-4551-8032-784b49f29979 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41442024-11-09T01:34:22.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1556 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 22cf9d69-03f4-4551-8032-784b49f29979 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41452024-11-09T01:34:23.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = af3211f6-9f3b-4b59-bb45-80f28f3cd6ef roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41462024-11-09T01:34:23.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = af3211f6-9f3b-4b59-bb45-80f28f3cd6ef resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41472024-11-09T01:34:23.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = af3211f6-9f3b-4b59-bb45-80f28f3cd6ef response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41482024-11-09T01:34:24.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 14adf08a-ff9f-4e24-baee-68cce6687e74 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41492024-11-09T01:34:24.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 14adf08a-ff9f-4e24-baee-68cce6687e74 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41502024-11-09T01:34:24.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 14adf08a-ff9f-4e24-baee-68cce6687e74 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41512024-11-09T01:34:25.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d49a6c0d-827e-4e56-8fd0-846351c7f9a2 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41522024-11-09T01:34:25.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d49a6c0d-827e-4e56-8fd0-846351c7f9a2 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41532024-11-09T01:34:25.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d49a6c0d-827e-4e56-8fd0-846351c7f9a2 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41542024-11-09T01:34:26.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a63f6897-105d-4379-b768-1d82b82de391 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41552024-11-09T01:34:26.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a63f6897-105d-4379-b768-1d82b82de391 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41562024-11-09T01:34:26.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a63f6897-105d-4379-b768-1d82b82de391 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41572024-11-09T01:34:27.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6a399419-2457-488e-99f3-6735dd3cc77c roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41582024-11-09T01:34:27.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6a399419-2457-488e-99f3-6735dd3cc77c resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41592024-11-09T01:34:27.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6a399419-2457-488e-99f3-6735dd3cc77c response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41602024-11-09T01:34:28.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 125a5101-b1bc-43dc-8f74-5bb975cecde4 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41612024-11-09T01:34:28.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 125a5101-b1bc-43dc-8f74-5bb975cecde4 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41622024-11-09T01:34:28.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 125a5101-b1bc-43dc-8f74-5bb975cecde4 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41632024-11-09T01:34:29.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
41642024-11-09T01:34:29.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
41652024-11-09T01:34:29.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41662024-11-09T01:34:29.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41672024-11-09T01:34:29.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41682024-11-09T01:34:29.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41692024-11-09T01:34:29.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41702024-11-09T01:34:29.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41712024-11-09T01:34:29.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41722024-11-09T01:34:29.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41732024-11-09T01:34:29.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41742024-11-09T01:34:29.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41752024-11-09T01:34:29.114ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41762024-11-09T01:34:29.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41772024-11-09T01:34:29.115ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.937654ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41782024-11-09T01:34:29.123ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41792024-11-09T01:34:29.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
41802024-11-09T01:34:29.125ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41812024-11-09T01:34:29.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41822024-11-09T01:34:29.137ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
41832024-11-09T01:34:29.137ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.132841ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
41842024-11-09T01:34:29.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 105ac6a7-221b-4965-a447-ee4e674709b8 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41852024-11-09T01:34:29.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 105ac6a7-221b-4965-a447-ee4e674709b8 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41862024-11-09T01:34:29.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 105ac6a7-221b-4965-a447-ee4e674709b8 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41872024-11-09T01:34:29.970ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1435 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = 9d92e436-859a-4f93-8edc-374820ba8747 response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
41882024-11-09T01:34:30.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4a371f12-f1aa-4762-ba6b-a537873bb3de roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41892024-11-09T01:34:30.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4a371f12-f1aa-4762-ba6b-a537873bb3de resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41902024-11-09T01:34:30.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4a371f12-f1aa-4762-ba6b-a537873bb3de response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41912024-11-09T01:34:31.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ef2c5730-c098-40bc-84fc-c739228a2853 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41922024-11-09T01:34:31.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ef2c5730-c098-40bc-84fc-c739228a2853 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41932024-11-09T01:34:31.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2026 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ef2c5730-c098-40bc-84fc-c739228a2853 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41942024-11-09T01:34:32.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 169e5d07-fa52-41e5-b4d7-d937284e6b27 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41952024-11-09T01:34:32.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 169e5d07-fa52-41e5-b4d7-d937284e6b27 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41962024-11-09T01:34:32.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 169e5d07-fa52-41e5-b4d7-d937284e6b27 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
41972024-11-09T01:34:33.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = f6761d97-f4fb-4e71-aa6c-39796bc7a6bc roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
41982024-11-09T01:34:33.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = f6761d97-f4fb-4e71-aa6c-39796bc7a6bc resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
41992024-11-09T01:34:33.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = f6761d97-f4fb-4e71-aa6c-39796bc7a6bc response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
42002024-11-09T01:34:33.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 21c4f235-aa2f-4fd3-a735-4f1918af3cc2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
42012024-11-09T01:34:33.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 21c4f235-aa2f-4fd3-a735-4f1918af3cc2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
42022024-11-09T01:34:33.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 21c4f235-aa2f-4fd3-a735-4f1918af3cc2 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
42032024-11-09T01:34:33.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 179c9585-f0c1-4eaf-b257-f00ae0645a42 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
42042024-11-09T01:34:33.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 179c9585-f0c1-4eaf-b257-f00ae0645a42 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
42052024-11-09T01:34:33.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1936 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 179c9585-f0c1-4eaf-b257-f00ae0645a42 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
42062024-11-09T01:34:34.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d132f629-1d0c-4609-b0ae-11683d56d851 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
42072024-11-09T01:34:34.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d132f629-1d0c-4609-b0ae-11683d56d851 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
42082024-11-09T01:34:34.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1838 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d132f629-1d0c-4609-b0ae-11683d56d851 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
42092024-11-09T01:34:34.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 58013935-0fc4-4ef1-885b-a0e8f22590dc roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
42102024-11-09T01:34:34.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 58013935-0fc4-4ef1-885b-a0e8f22590dc resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
42112024-11-09T01:34:34.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 58013935-0fc4-4ef1-885b-a0e8f22590dc response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
42122024-11-09T01:34:34.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = d06d67af-af4b-49a2-8c4e-b170e1fe0e56 roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
42132024-11-09T01:34:34.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = d06d67af-af4b-49a2-8c4e-b170e1fe0e56 resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
42142024-11-09T01:34:34.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = d06d67af-af4b-49a2-8c4e-b170e1fe0e56 response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
42152024-11-09T01:34:35.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a8af3609-33ee-4fe7-8496-5ed411e8fff3 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
42162024-11-09T01:34:35.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a8af3609-33ee-4fe7-8496-5ed411e8fff3 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
42172024-11-09T01:34:35.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a8af3609-33ee-4fe7-8496-5ed411e8fff3 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
42182024-11-09T01:34:36.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 215dbce4-67ce-4332-8d30-bd77647b88ab roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
42192024-11-09T01:34:36.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 215dbce4-67ce-4332-8d30-bd77647b88ab resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
42202024-11-09T01:34:36.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 215dbce4-67ce-4332-8d30-bd77647b88ab response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
42212024-11-09T01:34:37.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2f74414b-a62f-4d9a-89a8-54bdf6a40475 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
42222024-11-09T01:34:37.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2f74414b-a62f-4d9a-89a8-54bdf6a40475 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
42232024-11-09T01:34:37.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1706 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2f74414b-a62f-4d9a-89a8-54bdf6a40475 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
42242024-11-09T01:34:38.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2b5b7ecc-c391-4d05-a165-8376b83325d2 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
42252024-11-09T01:34:38.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2b5b7ecc-c391-4d05-a165-8376b83325d2 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
42262024-11-09T01:34:38.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1871 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2b5b7ecc-c391-4d05-a165-8376b83325d2 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
42272024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
42282024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
42292024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42302024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
42312024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
42322024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42332024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
42342024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
42352024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
42362024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42372024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42382024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
42392024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42402024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
42412024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
42422024-11-09T01:34:39.086ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
42432024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42442024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42452024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
42462024-11-09T01:34:39.086ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
42472024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42482024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
42492024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42502024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
42512024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
42522024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42532024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
42542024-11-09T01:34:39.086ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 01:24:39.086825488 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
42552024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
42562024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
42572024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
42582024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
42592024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42602024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
42612024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
42622024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
42632024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42642024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
42652024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42662024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42672024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
42682024-11-09T01:34:39.086ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
42692024-11-09T01:34:39.087ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079
42702024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.271\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079"}
42712024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
42722024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
42732024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42742024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
42752024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42762024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
42772024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
42782024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42792024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
42802024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 11.18\u{b5}s iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
42812024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
42822024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.84\u{b5}s iteration = 25 status = {"errors":[],"records_set_to_done":[]}
42832024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
42842024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
42852024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.86\u{b5}s iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
42862024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
42872024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
42882024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.73\u{b5}s iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
42892024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
42902024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
42912024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42922024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42932024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42942024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
42952024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
42962024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
42972024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42982024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
42992024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43002024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43012024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43022024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43032024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43042024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43052024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
43062024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43072024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
43082024-11-09T01:34:39.087ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("30d356ab-a881-4ca3-8f43-203be0381a68.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d55caa1f-cc37-4ecb-b8bf-58b9052db1d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d55caa1f-cc37-4ecb-b8bf-58b9052db1d9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1396, tv_nsec: 107396370 } })
43092024-11-09T01:34:39.087ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("34219892-cef8-4169-a366-ce17844120f6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("530f76d0-bec9-4ae0-beb0-d217f68ae05a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("530f76d0-bec9-4ae0-beb0-d217f68ae05a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1396, tv_nsec: 107393090 } })
43102024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43112024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43122024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43132024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43142024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43152024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43162024-11-09T01:34:39.087ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43172024-11-09T01:34:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43182024-11-09T01:34:39.088ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43192024-11-09T01:34:39.088ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
43202024-11-09T01:34:39.088ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.331765ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
43212024-11-09T01:34:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43222024-11-09T01:34:39.088ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43232024-11-09T01:34:39.088ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
43242024-11-09T01:34:39.088ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.212343ms iteration = 14 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
43252024-11-09T01:34:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43262024-11-09T01:34:39.089ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43272024-11-09T01:34:39.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43282024-11-09T01:34:39.091ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.752023ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43292024-11-09T01:34:39.091ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1396, tv_nsec: 111472086 } })
43302024-11-09T01:34:39.091ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
43312024-11-09T01:34:39.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43322024-11-09T01:34:39.092ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43332024-11-09T01:34:39.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43342024-11-09T01:34:39.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43352024-11-09T01:34:39.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43362024-11-09T01:34:39.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43372024-11-09T01:34:39.095ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 01:24:39.086825488 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
43382024-11-09T01:34:39.095ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.789558ms iteration = 13 status = {"expiration":"2024-11-09T01:24:39.086825488Z","pruned":[]}
43392024-11-09T01:34:39.095ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43402024-11-09T01:34:39.095ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43412024-11-09T01:34:39.096ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1396, tv_nsec: 116701034 } })
43422024-11-09T01:34:39.096ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43432024-11-09T01:34:39.097ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
43442024-11-09T01:34:39.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43452024-11-09T01:34:39.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43462024-11-09T01:34:39.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43472024-11-09T01:34:39.098ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43482024-11-09T01:34:39.098ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43492024-11-09T01:34:39.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43502024-11-09T01:34:39.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43512024-11-09T01:34:39.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43522024-11-09T01:34:39.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43532024-11-09T01:34:39.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43542024-11-09T01:34:39.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43552024-11-09T01:34:39.102ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.26438ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
43562024-11-09T01:34:39.102ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43572024-11-09T01:34:39.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43582024-11-09T01:34:39.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43592024-11-09T01:34:39.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43602024-11-09T01:34:39.107ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43612024-11-09T01:34:39.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43622024-11-09T01:34:39.107ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1396, tv_nsec: 127497574 } })
43632024-11-09T01:34:39.108ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
43642024-11-09T01:34:39.109ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43652024-11-09T01:34:39.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43662024-11-09T01:34:39.134ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43672024-11-09T01:34:39.136ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43682024-11-09T01:34:39.136ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43692024-11-09T01:34:39.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43702024-11-09T01:34:39.138ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43712024-11-09T01:34:39.141ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43722024-11-09T01:34:39.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43732024-11-09T01:34:39.142ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43742024-11-09T01:34:39.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43752024-11-09T01:34:39.143ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43762024-11-09T01:34:39.143ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.190728ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43772024-11-09T01:34:39.145ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
43782024-11-09T01:34:39.145ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
43792024-11-09T01:34:39.145ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 57.924566ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
43802024-11-09T01:34:39.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
43812024-11-09T01:34:39.145ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
43822024-11-09T01:34:39.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
43832024-11-09T01:34:39.146ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43842024-11-09T01:34:39.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43852024-11-09T01:34:39.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43862024-11-09T01:34:39.146ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43872024-11-09T01:34:39.147ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43882024-11-09T01:34:39.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
43892024-11-09T01:34:39.148ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43902024-11-09T01:34:39.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43912024-11-09T01:34:39.148ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43922024-11-09T01:34:39.148ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43932024-11-09T01:34:39.149ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43942024-11-09T01:34:39.149ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43952024-11-09T01:34:39.149ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43962024-11-09T01:34:39.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43972024-11-09T01:34:39.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
43982024-11-09T01:34:39.151ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43992024-11-09T01:34:39.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44002024-11-09T01:34:39.151ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44012024-11-09T01:34:39.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44022024-11-09T01:34:39.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44032024-11-09T01:34:39.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
44042024-11-09T01:34:39.152ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44052024-11-09T01:34:39.152ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44062024-11-09T01:34:39.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44072024-11-09T01:34:39.152ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44082024-11-09T01:34:39.153ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44092024-11-09T01:34:39.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44102024-11-09T01:34:39.154ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44112024-11-09T01:34:39.154ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44122024-11-09T01:34:39.154ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44132024-11-09T01:34:39.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44142024-11-09T01:34:39.154ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44152024-11-09T01:34:39.154ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44162024-11-09T01:34:39.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44172024-11-09T01:34:39.154ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44182024-11-09T01:34:39.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44192024-11-09T01:34:39.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44202024-11-09T01:34:39.155ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44212024-11-09T01:34:39.156ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44222024-11-09T01:34:39.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44232024-11-09T01:34:39.158ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44242024-11-09T01:34:39.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44252024-11-09T01:34:39.158ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44262024-11-09T01:34:39.158ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44272024-11-09T01:34:39.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44282024-11-09T01:34:39.160ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44292024-11-09T01:34:39.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44302024-11-09T01:34:39.167ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 80.925422ms iteration = 6 status = {"nsuccess":5}
44312024-11-09T01:34:39.176ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
44322024-11-09T01:34:39.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
44332024-11-09T01:34:39.177ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44342024-11-09T01:34:39.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44352024-11-09T01:34:39.178ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44362024-11-09T01:34:39.182ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44372024-11-09T01:34:39.182ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44382024-11-09T01:34:39.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44392024-11-09T01:34:39.183ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
44402024-11-09T01:34:39.183ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.607727ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
44412024-11-09T01:34:39.184ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
44422024-11-09T01:34:39.185ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
44432024-11-09T01:34:39.185ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
44442024-11-09T01:34:39.185ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44452024-11-09T01:34:39.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44462024-11-09T01:34:39.185ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44472024-11-09T01:34:39.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44482024-11-09T01:34:39.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44492024-11-09T01:34:39.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44502024-11-09T01:34:39.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44512024-11-09T01:34:39.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44522024-11-09T01:34:39.191ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44532024-11-09T01:34:39.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44542024-11-09T01:34:39.191ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
44552024-11-09T01:34:39.191ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 72269a3a-73dc-4fb3-8a06-f7b406523664 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
44562024-11-09T01:34:39.191ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44572024-11-09T01:34:39.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44582024-11-09T01:34:39.193ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44592024-11-09T01:34:39.197ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c24f6fb-cc5e-4758-a216-4357bbb5d813, lookup_type: ById(8c24f6fb-cc5e-4758-a216-4357bbb5d813) } result = Ok(())
44602024-11-09T01:34:39.197ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44612024-11-09T01:34:39.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44622024-11-09T01:34:39.199ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 112.413054ms iteration = 25 status = 0
44632024-11-09T01:34:39.203ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
44642024-11-09T01:34:39.203ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
44652024-11-09T01:34:39.203ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 117.091346ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
44662024-11-09T01:34:39.203ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44672024-11-09T01:34:39.203ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44682024-11-09T01:34:39.203ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44692024-11-09T01:34:39.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44702024-11-09T01:34:39.204ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
44712024-11-09T01:34:39.207ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
44722024-11-09T01:34:39.207ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
44732024-11-09T01:34:39.207ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
44742024-11-09T01:34:39.207ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44752024-11-09T01:34:39.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44762024-11-09T01:34:39.208ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 121.213152ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44772024-11-09T01:34:39.208ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44782024-11-09T01:34:39.209ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44792024-11-09T01:34:39.212ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44802024-11-09T01:34:39.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44812024-11-09T01:34:39.212ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44822024-11-09T01:34:39.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44832024-11-09T01:34:39.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
44842024-11-09T01:34:39.214ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44852024-11-09T01:34:39.214ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44862024-11-09T01:34:39.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44872024-11-09T01:34:39.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44882024-11-09T01:34:39.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44892024-11-09T01:34:39.215ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
44902024-11-09T01:34:39.215ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44912024-11-09T01:34:39.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44922024-11-09T01:34:39.220ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44932024-11-09T01:34:39.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44942024-11-09T01:34:39.223ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44952024-11-09T01:34:39.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44962024-11-09T01:34:39.249ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44972024-11-09T01:34:39.249ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44982024-11-09T01:34:39.249ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 162.29911ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44992024-11-09T01:34:39.254ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
45002024-11-09T01:34:39.254ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = dadc16e6-e16c-4c3f-bb19-4f189e9d1c26 dns_zone_name = oxide.test found_so_far = 0 version = 2
45012024-11-09T01:34:39.254ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45022024-11-09T01:34:39.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45032024-11-09T01:34:39.269ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
45042024-11-09T01:34:39.269ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45052024-11-09T01:34:39.270ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1079173-3438-48aa-958e-d5bac8d371da", "content-length": "26", "date": "Sat, 09 Nov 2024 01:34:39 GMT"} })
45062024-11-09T01:34:39.270ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45072024-11-09T01:34:39.272ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45082024-11-09T01:34:39.273ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
45092024-11-09T01:34:39.273ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45102024-11-09T01:34:39.273ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bbc0bb0-e52c-4981-89d3-f62f4f6dbe70", "content-length": "26", "date": "Sat, 09 Nov 2024 01:34:39 GMT"} })
45112024-11-09T01:34:39.273ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45122024-11-09T01:34:39.274ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 187.920976ms iteration = 29 status = {"physical_disks_added":0}
45132024-11-09T01:34:39.275ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45142024-11-09T01:34:39.275ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
45152024-11-09T01:34:39.275ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 189.180709ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
45162024-11-09T01:34:39.311ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba zone_address = fd00:1122:3344:101::2
45172024-11-09T01:34:39.311ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45182024-11-09T01:34:39.311ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0297b01a-cf5a-4b1d-94bb-a76d43f34980", "content-length": "26", "date": "Sat, 09 Nov 2024 01:34:39 GMT"} })
45192024-11-09T01:34:39.311ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45202024-11-09T01:34:39.313ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
45212024-11-09T01:34:39.381ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
45222024-11-09T01:34:39.381ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6ac092aa-56bf-44ba-8792-d02d80ca3ce8", "date": "Sat, 09 Nov 2024 01:34:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45232024-11-09T01:34:39.381ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45242024-11-09T01:34:39.383ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e1bddcd2-ae82-4d70-bd27-de048f534512", "date": "Sat, 09 Nov 2024 01:34:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45252024-11-09T01:34:39.383ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45262024-11-09T01:34:39.384ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45272024-11-09T01:34:39.384ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 297.972722ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
45282024-11-09T01:34:39.429ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45292024-11-09T01:34:39.429ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45302024-11-09T01:34:39.429ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ee73acd-bd81-4cd1-a861-8ac5b233064e", "content-length": "525", "date": "Sat, 09 Nov 2024 01:34:39 GMT"} })
45312024-11-09T01:34:39.429ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45322024-11-09T01:34:39.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45332024-11-09T01:34:39.458ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 371.905347ms iteration = 25 status = {}
45342024-11-09T01:34:39.461ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
45352024-11-09T01:34:39.461ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "adfa0332-b8b6-45a6-a236-28d0fce26b06", "content-length": "1", "date": "Sat, 09 Nov 2024 01:34:39 GMT"} })
45362024-11-09T01:34:39.463ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45372024-11-09T01:34:39.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45382024-11-09T01:34:39.565ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279/state
45392024-11-09T01:34:39.566ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
45402024-11-09T01:34:39.567ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45412024-11-09T01:34:39.568ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45422024-11-09T01:34:39.569ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 72269a3a-73dc-4fb3-8a06-f7b406523664 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
45432024-11-09T01:34:39.569ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
45442024-11-09T01:34:39.569ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 01:23:03.098267 UTC dns_group = internal generation = 1
45452024-11-09T01:34:39.569ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 482.45404ms iteration = 14 status = {"generation":1}
45462024-11-09T01:34:39.571ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
45472024-11-09T01:34:39.571ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45482024-11-09T01:34:39.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45492024-11-09T01:34:39.574ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 487.969101ms iteration = 25 status = null
45502024-11-09T01:34:39.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45512024-11-09T01:34:39.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45522024-11-09T01:34:39.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45532024-11-09T01:34:39.579ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = dadc16e6-e16c-4c3f-bb19-4f189e9d1c26 dns_zone_name = oxide.test found_so_far = 1 version = 2
45542024-11-09T01:34:39.579ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
45552024-11-09T01:34:39.579ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 01:23:03.974860 UTC dns_group = external generation = 2
45562024-11-09T01:34:39.579ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 492.727424ms iteration = 14 status = {"generation":2}
45572024-11-09T01:34:39.625ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T01:22:35.233443Z, time_modified: 2024-11-09T01:22:35.233443Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 539ccef2-8207-42b1-9e05-00e0a1387c35, db_silo: Silo { identity: SiloIdentity { id: 539ccef2-8207-42b1-9e05-00e0a1387c35, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T01:23:03.926223Z, time_modified: 2024-11-09T01:23:03.926223Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 539ccef2-8207-42b1-9e05-00e0a1387c35, db_silo: Silo { identity: SiloIdentity { id: 539ccef2-8207-42b1-9e05-00e0a1387c35, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T01:23:03.926223Z, time_modified: 2024-11-09T01:23:03.926223Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
45582024-11-09T01:34:39.625ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 538.652186ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"539ccef2-8207-42b1-9e05-00e0a1387c35","tls_certs":["22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248"]}},"default_endpoint":{"silo_id":"539ccef2-8207-42b1-9e05-00e0a1387c35","tls_certs":["22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
45592024-11-09T01:34:39.636ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {5098310f-c0e2-474e-9d72-f01deb6c2a82: {10.151.2.175: {93d41d84-55e9-4770-92f8-fe888fd5677b}, 10.151.2.176: {93d41d84-55e9-4770-92f8-fe888fd5677b}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
45602024-11-09T01:34:39.636ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
45612024-11-09T01:34:39.645ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "47926452-bf29-4214-9f52-9ab83373863f", "date": "Sat, 09 Nov 2024 01:34:39 GMT"} })
45622024-11-09T01:34:39.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45632024-11-09T01:34:39.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45642024-11-09T01:34:39.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45652024-11-09T01:34:39.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45662024-11-09T01:34:39.689ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
45672024-11-09T01:34:39.690ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "ca875c42-83c4-469a-b7f0-4b09f5a6551f", "date": "Sat, 09 Nov 2024 01:34:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
45682024-11-09T01:34:39.690ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
45692024-11-09T01:34:39.692ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3a8620f5-c76d-44d1-9c2e-4c43f6d1c703", "date": "Sat, 09 Nov 2024 01:34:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
45702024-11-09T01:34:39.692ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
45712024-11-09T01:34:39.693ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "3ddf0536-5754-470c-a09e-df65f503627c", "date": "Sat, 09 Nov 2024 01:34:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
45722024-11-09T01:34:39.693ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
45732024-11-09T01:34:39.695ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
45742024-11-09T01:34:39.695ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 608.840788ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
45752024-11-09T01:34:39.723ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45762024-11-09T01:34:39.723ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d5ea779-6e64-490f-aacb-40c45007e360", "content-length": "811", "date": "Sat, 09 Nov 2024 01:34:39 GMT"} })
45772024-11-09T01:34:39.723ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(10318096) }} sled = sock
45782024-11-09T01:34:39.723ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
45792024-11-09T01:34:39.723ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
45802024-11-09T01:34:39.724ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 637.730681ms iteration = 25 status = {}
45812024-11-09T01:34:39.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45822024-11-09T01:34:39.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45832024-11-09T01:34:39.729ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45842024-11-09T01:34:39.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45852024-11-09T01:34:39.732ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45862024-11-09T01:34:39.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45872024-11-09T01:34:39.735ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45882024-11-09T01:34:39.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45892024-11-09T01:34:39.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = dd605017-b66f-4d4b-9678-9b8643a90831 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
45902024-11-09T01:34:39.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = dd605017-b66f-4d4b-9678-9b8643a90831 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
45912024-11-09T01:34:39.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1831 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = dd605017-b66f-4d4b-9678-9b8643a90831 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
45922024-11-09T01:34:39.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45932024-11-09T01:34:39.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45942024-11-09T01:34:39.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45952024-11-09T01:34:39.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45962024-11-09T01:34:39.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45972024-11-09T01:34:39.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45982024-11-09T01:34:39.745ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45992024-11-09T01:34:39.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46002024-11-09T01:34:39.747ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46012024-11-09T01:34:39.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46022024-11-09T01:34:39.749ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46032024-11-09T01:34:39.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46042024-11-09T01:34:39.757ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46052024-11-09T01:34:39.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46062024-11-09T01:34:39.760ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 68cb9c64-43d4-4c3f-ba7b-013513b8c68d, rack_id: 54080907-d4a8-4f65-b867-da4e2da6d2ba, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8166ae85-b9fa-427c-9f22-e997378e0527) } rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
46072024-11-09T01:34:39.760ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46082024-11-09T01:34:39.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46092024-11-09T01:34:39.769ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46102024-11-09T01:34:39.769ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "128b46fc-4397-4700-b516-3d5417577332", "content-length": "134", "date": "Sat, 09 Nov 2024 01:34:39 GMT"} })
46112024-11-09T01:34:39.769ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
46122024-11-09T01:34:39.769ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8166ae85-b9fa-427c-9f22-e997378e0527
46132024-11-09T01:34:39.770ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46142024-11-09T01:34:39.770ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46152024-11-09T01:34:39.770ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46162024-11-09T01:34:39.770ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46172024-11-09T01:34:39.770ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46182024-11-09T01:34:39.770ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46192024-11-09T01:34:39.770ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46202024-11-09T01:34:39.770ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46212024-11-09T01:34:39.770ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
46222024-11-09T01:34:39.770ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46232024-11-09T01:34:39.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46242024-11-09T01:34:39.772ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46252024-11-09T01:34:39.773ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "07560685-3eda-4a61-ab1b-fd0166f94cf4", "content-length": "2", "date": "Sat, 09 Nov 2024 01:34:39 GMT"} })
46262024-11-09T01:34:39.773ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46272024-11-09T01:34:39.773ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "00d16e12-7ccf-4ef2-8590-c23347eba7e7", "content-length": "52", "date": "Sat, 09 Nov 2024 01:34:39 GMT"} })
46282024-11-09T01:34:39.773ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
46292024-11-09T01:34:39.773ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46302024-11-09T01:34:39.782ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46312024-11-09T01:34:39.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46322024-11-09T01:34:39.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46332024-11-09T01:34:39.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 539ccef2-8207-42b1-9e05-00e0a1387c35, lookup_type: ById(539ccef2-8207-42b1-9e05-00e0a1387c35) }, key: 5e4035bd-8282-4789-b187-6ad917fc02e7, lookup_type: ById(5e4035bd-8282-4789-b187-6ad917fc02e7) }, key: db6e6da2-9b26-4d99-b596-a4b144161516, lookup_type: ById(db6e6da2-9b26-4d99-b596-a4b144161516) }, key: a54938ce-5828-445e-a9a5-ebdb162c56bc, lookup_type: ById(a54938ce-5828-445e-a9a5-ebdb162c56bc) } result = Ok(())
46342024-11-09T01:34:39.820ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46352024-11-09T01:34:39.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46362024-11-09T01:34:39.829ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46372024-11-09T01:34:39.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46382024-11-09T01:34:39.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46392024-11-09T01:34:39.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46402024-11-09T01:34:39.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46412024-11-09T01:34:39.880ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 539ccef2-8207-42b1-9e05-00e0a1387c35, lookup_type: ById(539ccef2-8207-42b1-9e05-00e0a1387c35) }, key: 5e4035bd-8282-4789-b187-6ad917fc02e7, lookup_type: ById(5e4035bd-8282-4789-b187-6ad917fc02e7) }, key: db6e6da2-9b26-4d99-b596-a4b144161516, lookup_type: ById(db6e6da2-9b26-4d99-b596-a4b144161516) }, key: a54938ce-5828-445e-a9a5-ebdb162c56bc, lookup_type: ById(a54938ce-5828-445e-a9a5-ebdb162c56bc) } result = Ok(())
46422024-11-09T01:34:39.881ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46432024-11-09T01:34:39.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46442024-11-09T01:34:39.884ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46452024-11-09T01:34:39.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46462024-11-09T01:34:39.886ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46472024-11-09T01:34:39.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46482024-11-09T01:34:39.888ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46492024-11-09T01:34:39.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46502024-11-09T01:34:39.890ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46512024-11-09T01:34:39.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46522024-11-09T01:34:39.893ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46532024-11-09T01:34:39.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46542024-11-09T01:34:39.894ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46552024-11-09T01:34:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46562024-11-09T01:34:39.896ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46572024-11-09T01:34:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46582024-11-09T01:34:39.898ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46592024-11-09T01:34:39.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 539ccef2-8207-42b1-9e05-00e0a1387c35, lookup_type: ById(539ccef2-8207-42b1-9e05-00e0a1387c35) }, key: 5e4035bd-8282-4789-b187-6ad917fc02e7, lookup_type: ById(5e4035bd-8282-4789-b187-6ad917fc02e7) }, key: db6e6da2-9b26-4d99-b596-a4b144161516, lookup_type: ById(db6e6da2-9b26-4d99-b596-a4b144161516) }, key: 1e10a117-8896-4a23-8d3b-0f51185d990b, lookup_type: ByName("default") } result = Ok(())
46602024-11-09T01:34:39.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46612024-11-09T01:34:39.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46622024-11-09T01:34:39.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46632024-11-09T01:34:39.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46642024-11-09T01:34:39.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46652024-11-09T01:34:39.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46662024-11-09T01:34:39.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46672024-11-09T01:34:39.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46682024-11-09T01:34:39.918ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46692024-11-09T01:34:39.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46702024-11-09T01:34:39.920ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46712024-11-09T01:34:39.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46722024-11-09T01:34:39.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46732024-11-09T01:34:39.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46742024-11-09T01:34:39.923ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46752024-11-09T01:34:39.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 539ccef2-8207-42b1-9e05-00e0a1387c35, lookup_type: ById(539ccef2-8207-42b1-9e05-00e0a1387c35) }, key: 5e4035bd-8282-4789-b187-6ad917fc02e7, lookup_type: ById(5e4035bd-8282-4789-b187-6ad917fc02e7) }, key: db6e6da2-9b26-4d99-b596-a4b144161516, lookup_type: ById(db6e6da2-9b26-4d99-b596-a4b144161516) }, key: 93d41d84-55e9-4770-92f8-fe888fd5677b, lookup_type: ByName("default") } result = Ok(())
46762024-11-09T01:34:39.928ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
46772024-11-09T01:34:39.928ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46782024-11-09T01:34:39.936ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bb273773-2889-4a2e-9072-c4cdc4f88703", "date": "Sat, 09 Nov 2024 01:34:39 GMT"} })
46792024-11-09T01:34:39.936ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch = Switch0
46802024-11-09T01:34:39.936ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46812024-11-09T01:34:39.937ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0657f99f-3b1f-4cc4-8304-d28985fbed89", "content-length": "682", "date": "Sat, 09 Nov 2024 01:34:39 GMT"} })
46822024-11-09T01:34:39.937ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46832024-11-09T01:34:39.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46842024-11-09T01:34:39.937ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "222fb426-ee2e-4919-a7c9-37b11333a37d", "date": "Sat, 09 Nov 2024 01:34:39 GMT"} })
46852024-11-09T01:34:39.939ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 852.84943ms iteration = 26 status = {}
46862024-11-09T01:34:39.940ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46872024-11-09T01:34:39.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46882024-11-09T01:34:39.943ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46892024-11-09T01:34:39.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46902024-11-09T01:34:39.945ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46912024-11-09T01:34:39.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46922024-11-09T01:34:39.954ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 867.21524ms iteration = 25 status = {}
46932024-11-09T01:34:40.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c0727cce-0aeb-46ab-b6c1-4d278c9fea25 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
46942024-11-09T01:34:40.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c0727cce-0aeb-46ab-b6c1-4d278c9fea25 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
46952024-11-09T01:34:40.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c0727cce-0aeb-46ab-b6c1-4d278c9fea25 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
46962024-11-09T01:34:41.165ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "efa47b62-a376-4dd0-8a39-b2e33b73e7a4", "content-length": "131", "date": "Sat, 09 Nov 2024 01:34:41 GMT"} })
46972024-11-09T01:34:41.170ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4e873093-5b35-416b-9506-1d8591c05499 uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-09T01:34:41.166065012Z }
46982024-11-09T01:34:41.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4e873093-5b35-416b-9506-1d8591c05499 roles = RoleSet { roles: {} } uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
46992024-11-09T01:34:41.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4e873093-5b35-416b-9506-1d8591c05499 resource = Database result = Ok(()) uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
47002024-11-09T01:34:41.173ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-09T01:34:33.254804802Z }, migration_in: None, migration_out: None } vmm_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
47012024-11-09T01:34:41.173ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2151 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 vmm_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-09T01:34:33.254804802Z }
47022024-11-09T01:34:41.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 roles = RoleSet { roles: {} } sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 vmm_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
47032024-11-09T01:34:41.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 resource = Database result = Ok(()) sled_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 vmm_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279
47042024-11-09T01:34:41.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 14879 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4e873093-5b35-416b-9506-1d8591c05499 response_code = 204 uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
47052024-11-09T01:34:41.183ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 remote_addr = [fd00:1122:3344:101::1]:46575 req_id = da720207-cb48-4c35-a40d-b6701c313a7a uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-09T01:34:41.183469126Z }
47062024-11-09T01:34:41.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = da720207-cb48-4c35-a40d-b6701c313a7a roles = RoleSet { roles: {} } uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
47072024-11-09T01:34:41.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = da720207-cb48-4c35-a40d-b6701c313a7a resource = Database result = Ok(()) uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
47082024-11-09T01:34:41.202ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:53887
47092024-11-09T01:34:41.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:53887 req_id = e49ff5bb-ca8f-44f1-9cf0-c39c7284711e roles = RoleSet { roles: {} } uri = /metrics/producers
47102024-11-09T01:34:41.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:53887 req_id = e49ff5bb-ca8f-44f1-9cf0-c39c7284711e resource = Database result = Ok(()) uri = /metrics/producers
47112024-11-09T01:34:41.212ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
47122024-11-09T01:34:41.214ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 2.127222379s iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
47132024-11-09T01:34:41.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39172 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = da720207-cb48-4c35-a40d-b6701c313a7a response_code = 204 uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
47142024-11-09T01:34:41.246ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1
47152024-11-09T01:34:41.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41104 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:53887 req_id = e49ff5bb-ca8f-44f1-9cf0-c39c7284711e response_code = 201 uri = /metrics/producers
47162024-11-09T01:34:41.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b4d0cda6-dcdd-406b-8066-c67196e975cd roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47172024-11-09T01:34:41.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b4d0cda6-dcdd-406b-8066-c67196e975cd resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47182024-11-09T01:34:41.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b4d0cda6-dcdd-406b-8066-c67196e975cd response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47192024-11-09T01:34:42.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 74d834ea-9e12-4966-9f3c-60bf00ff8e79 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47202024-11-09T01:34:42.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 74d834ea-9e12-4966-9f3c-60bf00ff8e79 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47212024-11-09T01:34:42.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 74d834ea-9e12-4966-9f3c-60bf00ff8e79 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47222024-11-09T01:34:43.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5cd788d1-30b9-4ae8-977e-5a7baa744aca roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47232024-11-09T01:34:43.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5cd788d1-30b9-4ae8-977e-5a7baa744aca resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47242024-11-09T01:34:43.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1801 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5cd788d1-30b9-4ae8-977e-5a7baa744aca response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47252024-11-09T01:34:44.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bb228c87-d6fb-4e66-9a92-35abd9f4930c roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47262024-11-09T01:34:44.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bb228c87-d6fb-4e66-9a92-35abd9f4930c resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47272024-11-09T01:34:44.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bb228c87-d6fb-4e66-9a92-35abd9f4930c response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47282024-11-09T01:34:44.976ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1489 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = 5eba4b2b-b492-4b4b-bc37-290d765d9f67 response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
47292024-11-09T01:34:45.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0a1575c8-14f3-42d7-9e80-049bf532b429 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47302024-11-09T01:34:45.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0a1575c8-14f3-42d7-9e80-049bf532b429 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47312024-11-09T01:34:45.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2844 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0a1575c8-14f3-42d7-9e80-049bf532b429 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47322024-11-09T01:34:46.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a5654cb7-cc7f-4da2-9b2d-627b91b64ef3 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47332024-11-09T01:34:46.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a5654cb7-cc7f-4da2-9b2d-627b91b64ef3 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47342024-11-09T01:34:46.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a5654cb7-cc7f-4da2-9b2d-627b91b64ef3 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47352024-11-09T01:34:47.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ebb8898b-58d7-407d-9ecc-e4e264378240 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47362024-11-09T01:34:47.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ebb8898b-58d7-407d-9ecc-e4e264378240 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47372024-11-09T01:34:47.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ebb8898b-58d7-407d-9ecc-e4e264378240 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47382024-11-09T01:34:48.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 95acebd2-850c-4f08-b2c7-3335f81708dc roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47392024-11-09T01:34:48.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 95acebd2-850c-4f08-b2c7-3335f81708dc resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47402024-11-09T01:34:48.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1748 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 95acebd2-850c-4f08-b2c7-3335f81708dc response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47412024-11-09T01:34:49.087ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
47422024-11-09T01:34:49.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47432024-11-09T01:34:49.087ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
47442024-11-09T01:34:49.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47452024-11-09T01:34:49.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47462024-11-09T01:34:49.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47472024-11-09T01:34:49.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47482024-11-09T01:34:49.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47492024-11-09T01:34:49.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47502024-11-09T01:34:49.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47512024-11-09T01:34:49.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47522024-11-09T01:34:49.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47532024-11-09T01:34:49.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47542024-11-09T01:34:49.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
47552024-11-09T01:34:49.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47562024-11-09T01:34:49.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47572024-11-09T01:34:49.108ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
47582024-11-09T01:34:49.109ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.904614ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
47592024-11-09T01:34:49.115ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47602024-11-09T01:34:49.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47612024-11-09T01:34:49.143ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.332318ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47622024-11-09T01:34:49.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = c655fc58-eca5-445d-81de-ca4d5c61178c roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
47632024-11-09T01:34:49.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = c655fc58-eca5-445d-81de-ca4d5c61178c resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
47642024-11-09T01:34:49.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3523 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = c655fc58-eca5-445d-81de-ca4d5c61178c response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
47652024-11-09T01:34:49.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 71ddd202-e640-4e48-9909-89b7414cb42e roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
47662024-11-09T01:34:49.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 71ddd202-e640-4e48-9909-89b7414cb42e resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
47672024-11-09T01:34:49.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 71ddd202-e640-4e48-9909-89b7414cb42e response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
47682024-11-09T01:34:49.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e8c6a6a9-a718-4da0-8671-8dbc8bf8e079 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47692024-11-09T01:34:49.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e8c6a6a9-a718-4da0-8671-8dbc8bf8e079 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47702024-11-09T01:34:49.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e8c6a6a9-a718-4da0-8671-8dbc8bf8e079 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47712024-11-09T01:34:51.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c502f4c7-8012-48b7-aee3-ec53acc335a3 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47722024-11-09T01:34:51.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c502f4c7-8012-48b7-aee3-ec53acc335a3 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47732024-11-09T01:34:51.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2555 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c502f4c7-8012-48b7-aee3-ec53acc335a3 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47742024-11-09T01:34:51.291ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5f2eb3c0-d89d-4b04-b7cb-19777de04031 uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-09T01:34:51.291382118Z }
47752024-11-09T01:34:51.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5f2eb3c0-d89d-4b04-b7cb-19777de04031 roles = RoleSet { roles: {} } uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
47762024-11-09T01:34:51.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5f2eb3c0-d89d-4b04-b7cb-19777de04031 resource = Database result = Ok(()) uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
47772024-11-09T01:34:51.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43057 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5f2eb3c0-d89d-4b04-b7cb-19777de04031 response_code = 204 uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
47782024-11-09T01:34:51.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = eb89696a-c07b-40f5-9c8a-a8e5b00adba5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
47792024-11-09T01:34:51.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = eb89696a-c07b-40f5-9c8a-a8e5b00adba5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
47802024-11-09T01:34:51.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3761 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = eb89696a-c07b-40f5-9c8a-a8e5b00adba5 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
47812024-11-09T01:34:51.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = dec0c9ff-a19f-4631-be49-dda10afde5e2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
47822024-11-09T01:34:51.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = dec0c9ff-a19f-4631-be49-dda10afde5e2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
47832024-11-09T01:34:51.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = dec0c9ff-a19f-4631-be49-dda10afde5e2 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
47842024-11-09T01:34:52.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6cf1ba90-4f92-45e7-929f-798465614efb roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47852024-11-09T01:34:52.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6cf1ba90-4f92-45e7-929f-798465614efb resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47862024-11-09T01:34:52.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6cf1ba90-4f92-45e7-929f-798465614efb response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47872024-11-09T01:34:53.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 12d4bdbb-cb97-4575-9595-92d4564bf49b roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47882024-11-09T01:34:53.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 12d4bdbb-cb97-4575-9595-92d4564bf49b resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47892024-11-09T01:34:53.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2402 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 12d4bdbb-cb97-4575-9595-92d4564bf49b response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
47902024-11-09T01:34:53.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = e7cfcc95-6a2c-4067-93e2-02e9e7fb3b04 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
47912024-11-09T01:34:53.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = e7cfcc95-6a2c-4067-93e2-02e9e7fb3b04 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
47922024-11-09T01:34:53.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = e7cfcc95-6a2c-4067-93e2-02e9e7fb3b04 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
47932024-11-09T01:34:53.801ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19119775-8165-434a-855e-0b6d8f124660 uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-09T01:34:53.801262893Z }
47942024-11-09T01:34:53.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19119775-8165-434a-855e-0b6d8f124660 roles = RoleSet { roles: {} } uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
47952024-11-09T01:34:53.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19119775-8165-434a-855e-0b6d8f124660 resource = Database result = Ok(()) uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
47962024-11-09T01:34:53.820ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19119775-8165-434a-855e-0b6d8f124660 uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279 vmm_needs_update = true
47972024-11-09T01:34:53.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19119775-8165-434a-855e-0b6d8f124660 roles = RoleSet { roles: {} } uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
47982024-11-09T01:34:53.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19119775-8165-434a-855e-0b6d8f124660 resource = Database result = Ok(()) uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
47992024-11-09T01:34:53.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19119775-8165-434a-855e-0b6d8f124660 roles = RoleSet { roles: {} } uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
48002024-11-09T01:34:53.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19119775-8165-434a-855e-0b6d8f124660 resource = Database result = Ok(()) uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
48012024-11-09T01:34:53.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19119775-8165-434a-855e-0b6d8f124660 roles = RoleSet { roles: {} } uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
48022024-11-09T01:34:53.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19119775-8165-434a-855e-0b6d8f124660 resource = Database result = Ok(()) uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
48032024-11-09T01:34:53.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19119775-8165-434a-855e-0b6d8f124660 roles = RoleSet { roles: {} } uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
48042024-11-09T01:34:53.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19119775-8165-434a-855e-0b6d8f124660 resource = Database result = Ok(()) uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
48052024-11-09T01:34:53.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19119775-8165-434a-855e-0b6d8f124660 roles = RoleSet { roles: {} } uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
48062024-11-09T01:34:53.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19119775-8165-434a-855e-0b6d8f124660 resource = Database result = Ok(()) uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
48072024-11-09T01:34:53.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19119775-8165-434a-855e-0b6d8f124660 roles = RoleSet { roles: {} } uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
48082024-11-09T01:34:53.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19119775-8165-434a-855e-0b6d8f124660 resource = Database result = Ok(()) uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
48092024-11-09T01:34:53.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19119775-8165-434a-855e-0b6d8f124660 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
48102024-11-09T01:34:53.838ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19119775-8165-434a-855e-0b6d8f124660 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 539ccef2-8207-42b1-9e05-00e0a1387c35, lookup_type: ById(539ccef2-8207-42b1-9e05-00e0a1387c35) }, key: 5e4035bd-8282-4789-b187-6ad917fc02e7, lookup_type: ById(5e4035bd-8282-4789-b187-6ad917fc02e7) }, key: 7cdfd0f3-3f79-42b0-9066-174287e507e1, lookup_type: ById(7cdfd0f3-3f79-42b0-9066-174287e507e1) } result = Ok(()) uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
48112024-11-09T01:34:53.838ZINFOnexus (dropshot_internal): starting update saga for 7cdfd0f3-3f79-42b0-9066-174287e507e1 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19119775-8165-434a-855e-0b6d8f124660 uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-09T01:34:53.801262893Z }
48122024-11-09T01:34:53.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37399 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19119775-8165-434a-855e-0b6d8f124660 response_code = 204 uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
48132024-11-09T01:34:53.839ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 remote_addr = [fd00:1122:3344:101::1]:46575 req_id = db68ae4e-458e-4d8e-ac94-513d202ee1e4 uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-09T01:34:53.801262893Z }
48142024-11-09T01:34:53.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = db68ae4e-458e-4d8e-ac94-513d202ee1e4 roles = RoleSet { roles: {} } uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
48152024-11-09T01:34:53.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = db68ae4e-458e-4d8e-ac94-513d202ee1e4 resource = Database result = Ok(()) uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
48162024-11-09T01:34:53.841ZDEBGnexus (dropshot_internal): preparing instance-update saga for 7cdfd0f3-3f79-42b0-9066-174287e507e1... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 19119775-8165-434a-855e-0b6d8f124660 uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
48172024-11-09T01:34:53.841ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update
48182024-11-09T01:34:53.841ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"7cdfd0f3-3f79-42b0-9066-174287e507e1","lookup_type":{"ById":"7cdfd0f3-3f79-42b0-9066-174287e507e1"},"parent":{"key":"5e4035bd-8282-4789-b187-6ad917fc02e7","lookup_type":{"ById":"5e4035bd-8282-4789-b187-6ad917fc02e7"},"parent":{"key":"539ccef2-8207-42b1-9e05-00e0a1387c35","lookup_type":{"ById":"539ccef2-8207-42b1-9e05-00e0a1387c35"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
48192024-11-09T01:34:53.841ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update
48202024-11-09T01:34:53.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 30356 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:46575 req_id = db68ae4e-458e-4d8e-ac94-513d202ee1e4 response_code = 204 uri = /vmms/5af420a0-b4b5-4661-bc1a-e38adaa39279
48212024-11-09T01:34:53.873ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update
48222024-11-09T01:34:53.874ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
48232024-11-09T01:34:53.874ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
48242024-11-09T01:34:53.874ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8
48252024-11-09T01:34:53.882ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
48262024-11-09T01:34:53.883ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8
48272024-11-09T01:34:53.888ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
48282024-11-09T01:34:53.888ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8
48292024-11-09T01:34:53.892ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
48302024-11-09T01:34:53.892ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("e60eba37-367f-407d-9abe-cba744425445")) node_id = 0 saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8
48312024-11-09T01:34:53.897ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
48322024-11-09T01:34:53.897ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8
48332024-11-09T01:34:53.903ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update
48342024-11-09T01:34:53.903ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = LockInstance
48352024-11-09T01:34:53.903ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = LockInstance
48362024-11-09T01:34:53.907ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = LockInstance
48372024-11-09T01:34:53.908ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = LockInstance
48382024-11-09T01:34:53.909ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = LockInstance
48392024-11-09T01:34:53.910ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = LockInstance
48402024-11-09T01:34:53.911ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = LockInstance
48412024-11-09T01:34:53.911ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = LockInstance
48422024-11-09T01:34:53.913ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = LockInstance
48432024-11-09T01:34:53.913ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = LockInstance
48442024-11-09T01:34:53.914ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = LockInstance
48452024-11-09T01:34:53.914ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = LockInstance
48462024-11-09T01:34:53.915ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = LockInstance
48472024-11-09T01:34:53.918ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 539ccef2-8207-42b1-9e05-00e0a1387c35, lookup_type: ById(539ccef2-8207-42b1-9e05-00e0a1387c35) }, key: 5e4035bd-8282-4789-b187-6ad917fc02e7, lookup_type: ById(5e4035bd-8282-4789-b187-6ad917fc02e7) }, key: 7cdfd0f3-3f79-42b0-9066-174287e507e1, lookup_type: ById(7cdfd0f3-3f79-42b0-9066-174287e507e1) } result = Ok(()) saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = LockInstance
48482024-11-09T01:34:53.918ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = LockInstance updater_id = e60eba37-367f-407d-9abe-cba744425445
48492024-11-09T01:34:53.918ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = LockInstance
48502024-11-09T01:34:53.919ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = LockInstance
48512024-11-09T01:34:53.933ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = LockInstance updater_id = e60eba37-367f-407d-9abe-cba744425445
48522024-11-09T01:34:53.933ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = LockInstance
48532024-11-09T01:34:53.933ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = LockInstance
48542024-11-09T01:34:53.940ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 locked_gen = Generation(Generation(2)) saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = LockInstance updater_id = e60eba37-367f-407d-9abe-cba744425445
48552024-11-09T01:34:53.942ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
48562024-11-09T01:34:53.942ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("e60eba37-367f-407d-9abe-cba744425445")}) node_id = 1 saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8
48572024-11-09T01:34:53.946ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
48582024-11-09T01:34:53.946ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8
48592024-11-09T01:34:53.950ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
48602024-11-09T01:34:53.950ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
48612024-11-09T01:34:53.952ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
48622024-11-09T01:34:53.952ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
48632024-11-09T01:34:53.953ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
48642024-11-09T01:34:53.953ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
48652024-11-09T01:34:53.954ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
48662024-11-09T01:34:53.957ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 539ccef2-8207-42b1-9e05-00e0a1387c35, lookup_type: ById(539ccef2-8207-42b1-9e05-00e0a1387c35) }, key: 5e4035bd-8282-4789-b187-6ad917fc02e7, lookup_type: ById(5e4035bd-8282-4789-b187-6ad917fc02e7) }, key: 7cdfd0f3-3f79-42b0-9066-174287e507e1, lookup_type: ById(7cdfd0f3-3f79-42b0-9066-174287e507e1) } result = Ok(()) saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
48672024-11-09T01:34:53.957ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
48682024-11-09T01:34:53.958ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
48692024-11-09T01:34:53.966ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 5af420a0-b4b5-4661-bc1a-e38adaa39279, time_created: 2024-11-09T01:34:32.739360Z, time_deleted: None, instance_id: 7cdfd0f3-3f79-42b0-9066-174287e507e1, sled_id: 8c24f6fb-cc5e-4758-a216-4357bbb5d813, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-09T01:34:53.801262Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-09T01:34:30.699448Z, gen: Generation(Generation(3)), propolis_id: Some(5af420a0-b4b5-4661-bc1a-e38adaa39279), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(5af420a0-b4b5-4661-bc1a-e38adaa39279 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-09T01:34:53.966323874Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
48702024-11-09T01:34:53.966ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update
48712024-11-09T01:34:53.966ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"7cdfd0f3-3f79-42b0-9066-174287e507e1","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"5af420a0-b4b5-4661-bc1a-e38adaa39279"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"7cdfd0f3-3f79-42b0-9066-174287e507e1","lookup_type":{"ById":"7cdfd0f3-3f79-42b0-9066-174287e507e1"},"parent":{"key":"5e4035bd-8282-4789-b187-6ad917fc02e7","lookup_type":{"ById":"5e4035bd-8282-4789-b187-6ad917fc02e7"},"parent":{"key":"539ccef2-8207-42b1-9e05-00e0a1387c35","lookup_type":{"ById":"539ccef2-8207-42b1-9e05-00e0a1387c35"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"e60eba37-367f-407d-9abe-cba744425445"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"5e4035bd-8282-4789-b187-6ad917fc02e7","ram_diff":1073741824},"destroy_active_vmm":"5af420a0-b4b5-4661-bc1a-e38adaa39279","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-09T01:34:53.966323874Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
48722024-11-09T01:34:53.966ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update
48732024-11-09T01:34:53.971ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update
48742024-11-09T01:34:53.971ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
48752024-11-09T01:34:53.971ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
48762024-11-09T01:34:53.971ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
48772024-11-09T01:34:53.974ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
48782024-11-09T01:34:53.974ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
48792024-11-09T01:34:53.978ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
48802024-11-09T01:34:53.978ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
48812024-11-09T01:34:53.981ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
48822024-11-09T01:34:53.981ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("f359fdae-e172-4db0-a3c6-c2d9a26e9e56")) node_id = 0 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
48832024-11-09T01:34:53.985ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
48842024-11-09T01:34:53.985ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
48852024-11-09T01:34:53.992ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 parent_lock = UpdaterLock { updater_id: e60eba37-367f-407d-9abe-cba744425445, locked_gen: Generation(Generation(2)) } saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update
48862024-11-09T01:34:53.992ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = BecomeUpdater
48872024-11-09T01:34:53.992ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = BecomeUpdater
48882024-11-09T01:34:54.000ZDEBGnexus (SagaExecutor): inherited lock from e60eba37-367f-407d-9abe-cba744425445 to f359fdae-e172-4db0-a3c6-c2d9a26e9e56 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = e60eba37-367f-407d-9abe-cba744425445 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = BecomeUpdater updater_id = f359fdae-e172-4db0-a3c6-c2d9a26e9e56
48892024-11-09T01:34:54.000ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update
48902024-11-09T01:34:54.000ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
48912024-11-09T01:34:54.000ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("f359fdae-e172-4db0-a3c6-c2d9a26e9e56")}) node_id = 1 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
48922024-11-09T01:34:54.003ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
48932024-11-09T01:34:54.003ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
48942024-11-09T01:34:54.006ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
48952024-11-09T01:34:54.006ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
48962024-11-09T01:34:54.009ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
48972024-11-09T01:34:54.009ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
48982024-11-09T01:34:54.014ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update
48992024-11-09T01:34:54.017ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1
49002024-11-09T01:34:54.019ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = UpdateNetworkConfig
49012024-11-09T01:34:54.019ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = UpdateNetworkConfig
49022024-11-09T01:34:54.022ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = UpdateNetworkConfig
49032024-11-09T01:34:54.022ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = UpdateNetworkConfig
49042024-11-09T01:34:54.024ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
49052024-11-09T01:34:54.024ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = UpdateNetworkConfig
49062024-11-09T01:34:54.024ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = UpdateNetworkConfig
49072024-11-09T01:34:54.026ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
49082024-11-09T01:34:54.026ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
49092024-11-09T01:34:54.026ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
49102024-11-09T01:34:54.028ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
49112024-11-09T01:34:54.029ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
49122024-11-09T01:34:54.029ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
49132024-11-09T01:34:54.029ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
49142024-11-09T01:34:54.033ZDEBGnexus: notifying dendrite of updates instance_id = Some(7cdfd0f3-3f79-42b0-9066-174287e507e1 (instance)) switch = switch0
49152024-11-09T01:34:54.033ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1411, tv_nsec: 53449959 } })
49162024-11-09T01:34:54.034ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
49172024-11-09T01:34:54.064ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
49182024-11-09T01:34:54.064ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49192024-11-09T01:34:54.064ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "14047f57-a446-4b96-bc19-e93d0dc5d871", "content-length": "26", "date": "Sat, 09 Nov 2024 01:34:54 GMT"} })
49202024-11-09T01:34:54.064ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49212024-11-09T01:34:54.065ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49222024-11-09T01:34:54.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c2e5e7a5-efea-4575-aa45-b103751eb9af roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
49232024-11-09T01:34:54.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c2e5e7a5-efea-4575-aa45-b103751eb9af resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
49242024-11-09T01:34:54.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c2e5e7a5-efea-4575-aa45-b103751eb9af response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
49252024-11-09T01:34:54.095ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
49262024-11-09T01:34:54.095ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "c10f3313-ea22-43fe-9e31-9a3db0752acb", "content-length": "4", "date": "Sat, 09 Nov 2024 01:34:53 GMT"} })
49272024-11-09T01:34:54.097ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
49282024-11-09T01:34:54.097ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
49292024-11-09T01:34:54.104ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
49302024-11-09T01:34:54.104ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
49312024-11-09T01:34:54.112ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
49322024-11-09T01:34:54.112ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
49332024-11-09T01:34:54.134ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-09T01:34:54.117574Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 539ccef2-8207-42b1-9e05-00e0a1387c35, time_modified: Some(2024-11-09T01:34:54.117574Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 5e4035bd-8282-4789-b187-6ad917fc02e7, time_modified: Some(2024-11-09T01:34:54.117574Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update
49342024-11-09T01:34:54.134ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
49352024-11-09T01:34:54.134ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
49362024-11-09T01:34:54.138ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
49372024-11-09T01:34:54.138ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
49382024-11-09T01:34:54.143ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update
49392024-11-09T01:34:54.143ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = UnassignOximeterProducer
49402024-11-09T01:34:54.143ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = UnassignOximeterProducer
49412024-11-09T01:34:54.148ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b producer_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update
49422024-11-09T01:34:54.148ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = UnassignOximeterProducer
49432024-11-09T01:34:54.148ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = UnassignOximeterProducer
49442024-11-09T01:34:54.183ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update
49452024-11-09T01:34:54.185ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 7cdfd0f3-3f79-42b0-9066-174287e507e1 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/7cdfd0f3-3f79-42b0-9066-174287e507e1
49462024-11-09T01:34:54.199ZDEBGnexus (SagaExecutor): client response oximeter-collector = 7cdfd0f3-3f79-42b0-9066-174287e507e1 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/7cdfd0f3-3f79-42b0-9066-174287e507e1", status: 204, headers: {"x-request-id": "201e597f-a65f-4573-9309-f0e4829a33f9", "date": "Sat, 09 Nov 2024 01:34:54 GMT"} }) saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update
49472024-11-09T01:34:54.199ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b producer_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update
49482024-11-09T01:34:54.200ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
49492024-11-09T01:34:54.200ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
49502024-11-09T01:34:54.205ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
49512024-11-09T01:34:54.205ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
49522024-11-09T01:34:54.209ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 lock = UpdaterLock { updater_id: f359fdae-e172-4db0-a3c6-c2d9a26e9e56, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-09T01:34:53.966323874Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update
49532024-11-09T01:34:54.209ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = CommitInstanceUpdates
49542024-11-09T01:34:54.210ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = CommitInstanceUpdates
49552024-11-09T01:34:54.249ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 new_runtime = InstanceRuntimeState { time_updated: 2024-11-09T01:34:53.966323874Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update
49562024-11-09T01:34:54.249ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
49572024-11-09T01:34:54.249ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
49582024-11-09T01:34:54.249ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
49592024-11-09T01:34:54.249ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
49602024-11-09T01:34:54.249ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
49612024-11-09T01:34:54.249ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49622024-11-09T01:34:54.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49632024-11-09T01:34:54.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49642024-11-09T01:34:54.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49652024-11-09T01:34:54.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49662024-11-09T01:34:54.253ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49672024-11-09T01:34:54.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49682024-11-09T01:34:54.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49692024-11-09T01:34:54.254ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
49702024-11-09T01:34:54.254ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
49712024-11-09T01:34:54.254ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49722024-11-09T01:34:54.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49732024-11-09T01:34:54.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49742024-11-09T01:34:54.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49752024-11-09T01:34:54.259ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
49762024-11-09T01:34:54.259ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("7cdfd0f3-3f79-42b0-9066-174287e507e1"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("5af420a0-b4b5-4661-bc1a-e38adaa39279")}) node_id = 7 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
49772024-11-09T01:34:54.263ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
49782024-11-09T01:34:54.263ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
49792024-11-09T01:34:54.268ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
49802024-11-09T01:34:54.268ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
49812024-11-09T01:34:54.272ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
49822024-11-09T01:34:54.272ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
49832024-11-09T01:34:54.275ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update
49842024-11-09T01:34:54.275ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = ReleaseSledResources
49852024-11-09T01:34:54.276ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = ReleaseSledResources
49862024-11-09T01:34:54.287ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
49872024-11-09T01:34:54.287ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
49882024-11-09T01:34:54.291ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
49892024-11-09T01:34:54.291ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
49902024-11-09T01:34:54.296ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 propolis_id = 5af420a0-b4b5-4661-bc1a-e38adaa39279 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update
49912024-11-09T01:34:54.296ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = MarkVmmDeleted
49922024-11-09T01:34:54.297ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = MarkVmmDeleted
49932024-11-09T01:34:54.304ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
49942024-11-09T01:34:54.304ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
49952024-11-09T01:34:54.307ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
49962024-11-09T01:34:54.307ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
49972024-11-09T01:34:54.310ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
49982024-11-09T01:34:54.310ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
49992024-11-09T01:34:54.314ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
50002024-11-09T01:34:54.314ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
50012024-11-09T01:34:54.344ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
50022024-11-09T01:34:54.344ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50032024-11-09T01:34:54.344ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d25649e-0b55-4332-baef-d136e9127bda", "content-length": "372", "date": "Sat, 09 Nov 2024 01:34:54 GMT"} })
50042024-11-09T01:34:54.345ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50052024-11-09T01:34:54.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50062024-11-09T01:34:54.348ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = ChainSuccessorSaga
50072024-11-09T01:34:54.348ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = ChainSuccessorSaga
50082024-11-09T01:34:54.348ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50092024-11-09T01:34:54.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50102024-11-09T01:34:54.382ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = ChainSuccessorSaga
50112024-11-09T01:34:54.382ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = ChainSuccessorSaga
50122024-11-09T01:34:54.384ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = ChainSuccessorSaga
50132024-11-09T01:34:54.384ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = ChainSuccessorSaga
50142024-11-09T01:34:54.386ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = ChainSuccessorSaga
50152024-11-09T01:34:54.389ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 539ccef2-8207-42b1-9e05-00e0a1387c35, lookup_type: ById(539ccef2-8207-42b1-9e05-00e0a1387c35) }, key: 5e4035bd-8282-4789-b187-6ad917fc02e7, lookup_type: ById(5e4035bd-8282-4789-b187-6ad917fc02e7) }, key: 7cdfd0f3-3f79-42b0-9066-174287e507e1, lookup_type: ById(7cdfd0f3-3f79-42b0-9066-174287e507e1) } result = Ok(()) saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = ChainSuccessorSaga
50162024-11-09T01:34:54.389ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = ChainSuccessorSaga
50172024-11-09T01:34:54.389ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_node = ChainSuccessorSaga
50182024-11-09T01:34:54.394ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
50192024-11-09T01:34:54.394ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
50202024-11-09T01:34:54.394ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "28b9ca36-221a-4f32-a5cb-030852816833", "date": "Sat, 09 Nov 2024 01:34:54 GMT"} })
50212024-11-09T01:34:54.394ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50222024-11-09T01:34:54.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50232024-11-09T01:34:54.395ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1325 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update
50242024-11-09T01:34:54.395ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
50252024-11-09T01:34:54.395ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
50262024-11-09T01:34:54.395ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Signaled
50272024-11-09T01:34:54.395ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50282024-11-09T01:34:54.395ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50292024-11-09T01:34:54.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50302024-11-09T01:34:54.397ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50312024-11-09T01:34:54.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50322024-11-09T01:34:54.398ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50332024-11-09T01:34:54.398ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
50342024-11-09T01:34:54.398ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50352024-11-09T01:34:54.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50362024-11-09T01:34:54.399ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
50372024-11-09T01:34:54.399ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
50382024-11-09T01:34:54.401ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50392024-11-09T01:34:54.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50402024-11-09T01:34:54.401ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50412024-11-09T01:34:54.401ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50422024-11-09T01:34:54.401ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50432024-11-09T01:34:54.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50442024-11-09T01:34:54.405ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
50452024-11-09T01:34:54.405ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50462024-11-09T01:34:54.405ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "80efa8de-8146-4e34-a33f-54c2e50fb0b4", "date": "Sat, 09 Nov 2024 01:34:54 GMT"} })
50472024-11-09T01:34:54.406ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
50482024-11-09T01:34:54.406ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
50492024-11-09T01:34:54.407ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 157.610427ms iteration = 27 status = {}
50502024-11-09T01:34:54.412ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
50512024-11-09T01:34:54.412ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274
50522024-11-09T01:34:54.445ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50532024-11-09T01:34:54.445ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50542024-11-09T01:34:54.445ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 50.098929ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
50552024-11-09T01:34:54.448ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
50562024-11-09T01:34:54.448ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 saga_name = instance-update saga_result = SagaResult { saga_id: a8dd2c44-81d6-4784-ac23-63aeb5b3f274, saga_log: SagaLog { saga_id: a8dd2c44-81d6-4784-ac23-63aeb5b3f274, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("f359fdae-e172-4db0-a3c6-c2d9a26e9e56")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("f359fdae-e172-4db0-a3c6-c2d9a26e9e56")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("7cdfd0f3-3f79-42b0-9066-174287e507e1"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("5af420a0-b4b5-4661-bc1a-e38adaa39279")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("7cdfd0f3-3f79-42b0-9066-174287e507e1"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("5af420a0-b4b5-4661-bc1a-e38adaa39279")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("f359fdae-e172-4db0-a3c6-c2d9a26e9e56"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("f359fdae-e172-4db0-a3c6-c2d9a26e9e56")}} }) }
50572024-11-09T01:34:54.448ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = a8dd2c44-81d6-4784-ac23-63aeb5b3f274 instance_id = 7cdfd0f3-3f79-42b0-9066-174287e507e1 saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update
50582024-11-09T01:34:54.448ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
50592024-11-09T01:34:54.448ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8
50602024-11-09T01:34:54.449ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50612024-11-09T01:34:54.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50622024-11-09T01:34:54.452ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
50632024-11-09T01:34:54.452ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8
50642024-11-09T01:34:54.456ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
50652024-11-09T01:34:54.456ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8
50662024-11-09T01:34:54.460ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
50672024-11-09T01:34:54.460ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8
50682024-11-09T01:34:54.465ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update sec_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
50692024-11-09T01:34:54.465ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 2285416e-31e6-4c02-b5be-1ebe38742ea8 saga_name = start-instance-update saga_result = SagaResult { saga_id: 2285416e-31e6-4c02-b5be-1ebe38742ea8, saga_log: SagaLog { saga_id: 2285416e-31e6-4c02-b5be-1ebe38742ea8, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("e60eba37-367f-407d-9abe-cba744425445")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("e60eba37-367f-407d-9abe-cba744425445")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("e60eba37-367f-407d-9abe-cba744425445"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("e60eba37-367f-407d-9abe-cba744425445")}} }) }
50702024-11-09T01:34:54.477ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50712024-11-09T01:34:54.479ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50722024-11-09T01:34:54.479ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50732024-11-09T01:34:54.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50742024-11-09T01:34:54.481ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50752024-11-09T01:34:54.483ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50762024-11-09T01:34:54.483ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50772024-11-09T01:34:54.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50782024-11-09T01:34:54.516ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50792024-11-09T01:34:54.516ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ec02c7b-fa3b-4be9-b0d9-95f17b08ee09", "content-length": "691", "date": "Sat, 09 Nov 2024 01:34:54 GMT"} })
50802024-11-09T01:34:54.517ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
50812024-11-09T01:34:54.517ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
50822024-11-09T01:34:54.517ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
50832024-11-09T01:34:54.517ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 268.16594ms iteration = 26 status = {}
50842024-11-09T01:34:54.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = f4ff6fbe-b21a-4672-b98f-4ef5729b7ec4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
50852024-11-09T01:34:54.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = f4ff6fbe-b21a-4672-b98f-4ef5729b7ec4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
50862024-11-09T01:34:54.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = f4ff6fbe-b21a-4672-b98f-4ef5729b7ec4 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
50872024-11-09T01:34:55.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 00610b40-eede-4155-877d-42e050e38f23 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
50882024-11-09T01:34:55.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 00610b40-eede-4155-877d-42e050e38f23 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
50892024-11-09T01:34:55.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 00610b40-eede-4155-877d-42e050e38f23 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
50902024-11-09T01:34:56.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d997ef1f-64d9-4dd6-9406-8c5724d8d0b6 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
50912024-11-09T01:34:56.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d997ef1f-64d9-4dd6-9406-8c5724d8d0b6 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
50922024-11-09T01:34:56.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2383 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d997ef1f-64d9-4dd6-9406-8c5724d8d0b6 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
50932024-11-09T01:34:57.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 990bf38b-2876-4c86-98ab-9fc6e4b87cab roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
50942024-11-09T01:34:57.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 990bf38b-2876-4c86-98ab-9fc6e4b87cab resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
50952024-11-09T01:34:57.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2552 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 990bf38b-2876-4c86-98ab-9fc6e4b87cab response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
50962024-11-09T01:34:58.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9a7db4d3-3925-41a1-81a5-0e9269a5fb7e roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
50972024-11-09T01:34:58.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9a7db4d3-3925-41a1-81a5-0e9269a5fb7e resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
50982024-11-09T01:34:58.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9a7db4d3-3925-41a1-81a5-0e9269a5fb7e response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
50992024-11-09T01:34:59.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
51002024-11-09T01:34:59.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
51012024-11-09T01:34:59.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51022024-11-09T01:34:59.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51032024-11-09T01:34:59.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51042024-11-09T01:34:59.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51052024-11-09T01:34:59.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51062024-11-09T01:34:59.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51072024-11-09T01:34:59.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51082024-11-09T01:34:59.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51092024-11-09T01:34:59.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51102024-11-09T01:34:59.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51112024-11-09T01:34:59.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51122024-11-09T01:34:59.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
51132024-11-09T01:34:59.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51142024-11-09T01:34:59.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51152024-11-09T01:34:59.113ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
51162024-11-09T01:34:59.113ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.204703ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
51172024-11-09T01:34:59.120ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51182024-11-09T01:34:59.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51192024-11-09T01:34:59.122ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.980501ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51202024-11-09T01:34:59.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9395b043-3289-4265-af2a-d7211082e872 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51212024-11-09T01:34:59.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9395b043-3289-4265-af2a-d7211082e872 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51222024-11-09T01:34:59.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9395b043-3289-4265-af2a-d7211082e872 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51232024-11-09T01:34:59.972ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1958 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = 8a56e7ba-75fa-4fb6-b2af-ed2407999d75 response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
51242024-11-09T01:35:00.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4bcfbab2-32d7-443f-8984-aec52b5d5227 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51252024-11-09T01:35:00.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4bcfbab2-32d7-443f-8984-aec52b5d5227 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51262024-11-09T01:35:00.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2782 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4bcfbab2-32d7-443f-8984-aec52b5d5227 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51272024-11-09T01:35:01.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c1cc0918-54ca-4afe-9e96-1fc3de086ef9 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51282024-11-09T01:35:01.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c1cc0918-54ca-4afe-9e96-1fc3de086ef9 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51292024-11-09T01:35:01.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c1cc0918-54ca-4afe-9e96-1fc3de086ef9 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51302024-11-09T01:35:02.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7f989e9e-9a8f-45a4-9346-7572bfb453bf roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51312024-11-09T01:35:02.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7f989e9e-9a8f-45a4-9346-7572bfb453bf resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51322024-11-09T01:35:02.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7f989e9e-9a8f-45a4-9346-7572bfb453bf response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51332024-11-09T01:35:03.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 27865b59-feda-49ec-b3fc-ec3017a5437b roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51342024-11-09T01:35:03.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 27865b59-feda-49ec-b3fc-ec3017a5437b resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51352024-11-09T01:35:03.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2845 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 27865b59-feda-49ec-b3fc-ec3017a5437b response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51362024-11-09T01:35:04.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2e40bbaa-fef3-4046-b7c9-6b71fb1c877f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51372024-11-09T01:35:04.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2e40bbaa-fef3-4046-b7c9-6b71fb1c877f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51382024-11-09T01:35:04.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2e40bbaa-fef3-4046-b7c9-6b71fb1c877f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51392024-11-09T01:35:04.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 655d638f-78a9-4045-ad48-a433333ecfb3 roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
51402024-11-09T01:35:04.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 655d638f-78a9-4045-ad48-a433333ecfb3 resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
51412024-11-09T01:35:04.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 655d638f-78a9-4045-ad48-a433333ecfb3 response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
51422024-11-09T01:35:04.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 219d5391-2266-4c8a-8402-10e64723db92 roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
51432024-11-09T01:35:04.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 219d5391-2266-4c8a-8402-10e64723db92 resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
51442024-11-09T01:35:04.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 219d5391-2266-4c8a-8402-10e64723db92 response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
51452024-11-09T01:35:05.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 481d3e64-db28-482f-8cb4-370fddcabfc7 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51462024-11-09T01:35:05.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 481d3e64-db28-482f-8cb4-370fddcabfc7 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51472024-11-09T01:35:05.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2364 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 481d3e64-db28-482f-8cb4-370fddcabfc7 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51482024-11-09T01:35:05.758ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:63157
51492024-11-09T01:35:05.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63157 req_id = 645a52e5-8364-45e8-a283-21eb329ab261 roles = RoleSet { roles: {} } uri = /metrics/producers
51502024-11-09T01:35:05.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63157 req_id = 645a52e5-8364-45e8-a283-21eb329ab261 resource = Database result = Ok(()) uri = /metrics/producers
51512024-11-09T01:35:05.795ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = 7482031d-4c61-41c0-af62-0f1c419521b3
51522024-11-09T01:35:05.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36555 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63157 req_id = 645a52e5-8364-45e8-a283-21eb329ab261 response_code = 201 uri = /metrics/producers
51532024-11-09T01:35:06.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3dc498e8-6300-4bf7-98ee-ec67db4f2811 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51542024-11-09T01:35:06.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3dc498e8-6300-4bf7-98ee-ec67db4f2811 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51552024-11-09T01:35:06.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3dc498e8-6300-4bf7-98ee-ec67db4f2811 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51562024-11-09T01:35:07.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 28303971-0c36-413e-9907-243d206697b0 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51572024-11-09T01:35:07.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 28303971-0c36-413e-9907-243d206697b0 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51582024-11-09T01:35:07.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2591 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 28303971-0c36-413e-9907-243d206697b0 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51592024-11-09T01:35:08.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 1484c63c-f94f-424c-a83c-a4fc3ebbdec3 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51602024-11-09T01:35:08.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 1484c63c-f94f-424c-a83c-a4fc3ebbdec3 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51612024-11-09T01:35:08.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2622 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 1484c63c-f94f-424c-a83c-a4fc3ebbdec3 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
51622024-11-09T01:35:09.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
51632024-11-09T01:35:09.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51642024-11-09T01:35:09.086ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
51652024-11-09T01:35:09.086ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
51662024-11-09T01:35:09.086ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51672024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
51682024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51692024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
51702024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
51712024-11-09T01:35:09.087ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
51722024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51732024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51742024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
51752024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
51762024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51772024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
51782024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
51792024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51802024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
51812024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
51822024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51832024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
51842024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
51852024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51862024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51872024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
51882024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51892024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51902024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51912024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51922024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51932024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51942024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
51952024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51962024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51972024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51982024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51992024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52002024-11-09T01:35:09.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52012024-11-09T01:35:09.088ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
52022024-11-09T01:35:09.088ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
52032024-11-09T01:35:09.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 13.81\u{b5}s iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
52042024-11-09T01:35:09.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.28\u{b5}s iteration = 26 status = {"errors":[],"records_set_to_done":[]}
52052024-11-09T01:35:09.088ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
52062024-11-09T01:35:09.088ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
52072024-11-09T01:35:09.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.53\u{b5}s iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
52082024-11-09T01:35:09.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.23\u{b5}s iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
52092024-11-09T01:35:09.089ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52102024-11-09T01:35:09.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52112024-11-09T01:35:09.089ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52122024-11-09T01:35:09.090ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1426, tv_nsec: 110081420 } })
52132024-11-09T01:35:09.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52142024-11-09T01:35:09.090ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
52152024-11-09T01:35:09.091ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.108816ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
52162024-11-09T01:35:09.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52172024-11-09T01:35:09.092ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1426, tv_nsec: 111960091 } })
52182024-11-09T01:35:09.092ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
52192024-11-09T01:35:09.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
52202024-11-09T01:35:09.092ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52212024-11-09T01:35:09.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52222024-11-09T01:35:09.093ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52232024-11-09T01:35:09.093ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52242024-11-09T01:35:09.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52252024-11-09T01:35:09.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52262024-11-09T01:35:09.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52272024-11-09T01:35:09.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52282024-11-09T01:35:09.095ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52292024-11-09T01:35:09.095ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52302024-11-09T01:35:09.095ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
52312024-11-09T01:35:09.095ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52322024-11-09T01:35:09.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52332024-11-09T01:35:09.097ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52342024-11-09T01:35:09.097ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52352024-11-09T01:35:09.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52362024-11-09T01:35:09.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52372024-11-09T01:35:09.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
52382024-11-09T01:35:09.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52392024-11-09T01:35:09.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52402024-11-09T01:35:09.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52412024-11-09T01:35:09.099ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52422024-11-09T01:35:09.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52432024-11-09T01:35:09.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52442024-11-09T01:35:09.102ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52452024-11-09T01:35:09.102ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
52462024-11-09T01:35:09.102ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52472024-11-09T01:35:09.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52482024-11-09T01:35:09.102ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1426, tv_nsec: 122138275 } })
52492024-11-09T01:35:09.102ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
52502024-11-09T01:35:09.121ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52512024-11-09T01:35:09.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52522024-11-09T01:35:09.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52532024-11-09T01:35:09.123ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52542024-11-09T01:35:09.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52552024-11-09T01:35:09.124ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.944193ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52562024-11-09T01:35:09.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
52572024-11-09T01:35:09.126ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52582024-11-09T01:35:09.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52592024-11-09T01:35:09.127ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52602024-11-09T01:35:09.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52612024-11-09T01:35:09.130ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52622024-11-09T01:35:09.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52632024-11-09T01:35:09.132ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52642024-11-09T01:35:09.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52652024-11-09T01:35:09.133ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
52662024-11-09T01:35:09.133ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 46.733552ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
52672024-11-09T01:35:09.134ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52682024-11-09T01:35:09.134ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52692024-11-09T01:35:09.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52702024-11-09T01:35:09.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52712024-11-09T01:35:09.135ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52722024-11-09T01:35:09.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52732024-11-09T01:35:09.136ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52742024-11-09T01:35:09.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52752024-11-09T01:35:09.137ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52762024-11-09T01:35:09.137ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
52772024-11-09T01:35:09.137ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 50.15526ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
52782024-11-09T01:35:09.138ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 51.146941ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52792024-11-09T01:35:09.146ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52802024-11-09T01:35:09.146ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52812024-11-09T01:35:09.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52822024-11-09T01:35:09.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
52832024-11-09T01:35:09.148ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52842024-11-09T01:35:09.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52852024-11-09T01:35:09.150ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52862024-11-09T01:35:09.152ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52872024-11-09T01:35:09.152ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52882024-11-09T01:35:09.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52892024-11-09T01:35:09.153ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52902024-11-09T01:35:09.155ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52912024-11-09T01:35:09.155ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52922024-11-09T01:35:09.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52932024-11-09T01:35:09.161ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
52942024-11-09T01:35:09.161ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 74.852124ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
52952024-11-09T01:35:09.162ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52962024-11-09T01:35:09.165ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c24f6fb-cc5e-4758-a216-4357bbb5d813, lookup_type: ById(8c24f6fb-cc5e-4758-a216-4357bbb5d813) } result = Ok(())
52972024-11-09T01:35:09.165ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52982024-11-09T01:35:09.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52992024-11-09T01:35:09.167ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 80.527098ms iteration = 26 status = 0
53002024-11-09T01:35:09.170ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 83.203758ms iteration = 30 status = {"physical_disks_added":0}
53012024-11-09T01:35:09.175ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
53022024-11-09T01:35:09.175ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53032024-11-09T01:35:09.176ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef3e234c-3f96-472a-a301-f09787a1d1e3", "content-length": "26", "date": "Sat, 09 Nov 2024 01:35:09 GMT"} })
53042024-11-09T01:35:09.176ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53052024-11-09T01:35:09.178ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53062024-11-09T01:35:09.186ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
53072024-11-09T01:35:09.186ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53082024-11-09T01:35:09.186ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1631102c-665d-4a6b-af76-98b61de34689", "content-length": "26", "date": "Sat, 09 Nov 2024 01:35:09 GMT"} })
53092024-11-09T01:35:09.186ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53102024-11-09T01:35:09.188ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53112024-11-09T01:35:09.210ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba zone_address = fd00:1122:3344:101::2
53122024-11-09T01:35:09.210ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53132024-11-09T01:35:09.210ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "16b73369-9454-4f92-a698-dd2c5b80c8f9", "content-length": "26", "date": "Sat, 09 Nov 2024 01:35:09 GMT"} })
53142024-11-09T01:35:09.210ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53152024-11-09T01:35:09.211ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
53162024-11-09T01:35:09.286ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
53172024-11-09T01:35:09.286ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53182024-11-09T01:35:09.287ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c1fb9d0-90b8-46ce-95aa-b0a58a18287b", "content-length": "372", "date": "Sat, 09 Nov 2024 01:35:09 GMT"} })
53192024-11-09T01:35:09.287ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53202024-11-09T01:35:09.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53212024-11-09T01:35:09.300ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
53222024-11-09T01:35:09.301ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
53232024-11-09T01:35:09.301ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cde4b0e2-923a-43c2-8acc-c100f50ba300", "date": "Sat, 09 Nov 2024 01:35:09 GMT"} })
53242024-11-09T01:35:09.301ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53252024-11-09T01:35:09.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53262024-11-09T01:35:09.303ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53272024-11-09T01:35:09.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53282024-11-09T01:35:09.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53292024-11-09T01:35:09.305ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
53302024-11-09T01:35:09.305ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f519b4d7-25d5-4da7-8f57-7fee0f7cde7c", "content-length": "2", "date": "Sat, 09 Nov 2024 01:35:08 GMT"} })
53312024-11-09T01:35:09.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53322024-11-09T01:35:09.307ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53332024-11-09T01:35:09.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53342024-11-09T01:35:09.370ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
53352024-11-09T01:35:09.371ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0635fe02-06b8-49d8-9415-02936e639496", "content-length": "691", "date": "Sat, 09 Nov 2024 01:35:09 GMT"} })
53362024-11-09T01:35:09.371ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
53372024-11-09T01:35:09.371ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
53382024-11-09T01:35:09.371ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
53392024-11-09T01:35:09.372ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 285.450973ms iteration = 27 status = {}
53402024-11-09T01:35:09.373ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 286.10128ms iteration = 26 status = null
53412024-11-09T01:35:09.373ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
53422024-11-09T01:35:09.373ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53432024-11-09T01:35:09.373ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f53c2e06-ad4c-49b0-a2a3-f7d0851e98d3", "date": "Sat, 09 Nov 2024 01:35:09 GMT"} })
53442024-11-09T01:35:09.375ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 288.098333ms iteration = 28 status = {}
53452024-11-09T01:35:09.378ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 291.625302ms iteration = 26 status = {}
53462024-11-09T01:35:09.417ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53472024-11-09T01:35:09.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53482024-11-09T01:35:09.419ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 68cb9c64-43d4-4c3f-ba7b-013513b8c68d, rack_id: 54080907-d4a8-4f65-b867-da4e2da6d2ba, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8166ae85-b9fa-427c-9f22-e997378e0527) } rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
53492024-11-09T01:35:09.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53502024-11-09T01:35:09.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53512024-11-09T01:35:09.429ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
53522024-11-09T01:35:09.429ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb4cf0fd-a3b0-47f6-a0de-1341de28c3e0", "content-length": "134", "date": "Sat, 09 Nov 2024 01:35:09 GMT"} })
53532024-11-09T01:35:09.429ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
53542024-11-09T01:35:09.429ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8166ae85-b9fa-427c-9f22-e997378e0527
53552024-11-09T01:35:09.429ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
53562024-11-09T01:35:09.429ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
53572024-11-09T01:35:09.429ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53582024-11-09T01:35:09.429ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53592024-11-09T01:35:09.429ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53602024-11-09T01:35:09.429ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53612024-11-09T01:35:09.429ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53622024-11-09T01:35:09.429ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53632024-11-09T01:35:09.430ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
53642024-11-09T01:35:09.430ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53652024-11-09T01:35:09.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53662024-11-09T01:35:09.431ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
53672024-11-09T01:35:09.431ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "234b3c47-834f-427e-b2a1-f508ce5f3c0e", "content-length": "2", "date": "Sat, 09 Nov 2024 01:35:09 GMT"} })
53682024-11-09T01:35:09.431ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
53692024-11-09T01:35:09.431ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba8e613c-043d-4de8-9d28-996aaaa895c2", "content-length": "52", "date": "Sat, 09 Nov 2024 01:35:09 GMT"} })
53702024-11-09T01:35:09.431ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
53712024-11-09T01:35:09.431ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
53722024-11-09T01:35:09.541ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7f30bbb6-04c1-4233-b9dc-b6038d669c0c", "date": "Sat, 09 Nov 2024 01:35:09 GMT"} })
53732024-11-09T01:35:09.541ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch = Switch0
53742024-11-09T01:35:09.541ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
53752024-11-09T01:35:09.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 18e0cb47-2952-4038-9305-31138095f586 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
53762024-11-09T01:35:09.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 18e0cb47-2952-4038-9305-31138095f586 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
53772024-11-09T01:35:09.541ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5c0c71b-452f-4b89-be15-42aa72a1786c", "content-length": "682", "date": "Sat, 09 Nov 2024 01:35:09 GMT"} })
53782024-11-09T01:35:09.544ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53792024-11-09T01:35:09.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5939 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 18e0cb47-2952-4038-9305-31138095f586 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
53802024-11-09T01:35:09.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53812024-11-09T01:35:09.551ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53822024-11-09T01:35:09.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53832024-11-09T01:35:09.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53842024-11-09T01:35:09.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53852024-11-09T01:35:09.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53862024-11-09T01:35:09.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53872024-11-09T01:35:09.567ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 480.518597ms iteration = 26 status = {}
53882024-11-09T01:35:09.730ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:46661
53892024-11-09T01:35:09.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46661 req_id = f501c443-89ef-4d38-9073-0dbcaa6ff883 roles = RoleSet { roles: {} } uri = /metrics/producers
53902024-11-09T01:35:09.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46661 req_id = f501c443-89ef-4d38-9073-0dbcaa6ff883 resource = Database result = Ok(()) uri = /metrics/producers
53912024-11-09T01:35:09.739ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = 0b7e3a2a-2678-430a-9e61-79da480570a8
53922024-11-09T01:35:09.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9043 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46661 req_id = f501c443-89ef-4d38-9073-0dbcaa6ff883 response_code = 201 uri = /metrics/producers
53932024-11-09T01:35:10.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 44c7c311-83c0-4a1c-9c3f-742a056c3705 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
53942024-11-09T01:35:10.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 44c7c311-83c0-4a1c-9c3f-742a056c3705 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
53952024-11-09T01:35:10.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1792 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 44c7c311-83c0-4a1c-9c3f-742a056c3705 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
53962024-11-09T01:35:11.306ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:41480
53972024-11-09T01:35:11.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41480 req_id = a5118126-ca89-4fe6-9753-3e7db78f85fd roles = RoleSet { roles: {} } uri = /metrics/producers
53982024-11-09T01:35:11.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41480 req_id = a5118126-ca89-4fe6-9753-3e7db78f85fd resource = Database result = Ok(()) uri = /metrics/producers
53992024-11-09T01:35:11.343ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = 8c24f6fb-cc5e-4758-a216-4357bbb5d813
54002024-11-09T01:35:11.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36303 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41480 req_id = a5118126-ca89-4fe6-9753-3e7db78f85fd response_code = 201 uri = /metrics/producers
54012024-11-09T01:35:11.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = dadaea05-591c-4f20-9bb7-8cd0cff5010f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54022024-11-09T01:35:11.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = dadaea05-591c-4f20-9bb7-8cd0cff5010f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54032024-11-09T01:35:11.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2464 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = dadaea05-591c-4f20-9bb7-8cd0cff5010f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54042024-11-09T01:35:12.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 07b33c1c-4f8e-4f01-8959-51f05c08b4ec roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54052024-11-09T01:35:12.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 07b33c1c-4f8e-4f01-8959-51f05c08b4ec resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54062024-11-09T01:35:12.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2520 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 07b33c1c-4f8e-4f01-8959-51f05c08b4ec response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54072024-11-09T01:35:13.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f73536e7-91a6-4bdb-be0a-bb4192bc7b27 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54082024-11-09T01:35:13.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f73536e7-91a6-4bdb-be0a-bb4192bc7b27 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54092024-11-09T01:35:13.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f73536e7-91a6-4bdb-be0a-bb4192bc7b27 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54102024-11-09T01:35:14.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 914b511b-00ca-42ff-ba8a-0a31c38eb1c6 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54112024-11-09T01:35:14.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 914b511b-00ca-42ff-ba8a-0a31c38eb1c6 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54122024-11-09T01:35:14.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1905 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 914b511b-00ca-42ff-ba8a-0a31c38eb1c6 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54132024-11-09T01:35:14.972ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1614 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = 383db7e3-5de7-4a4e-a460-3391e6786aba response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
54142024-11-09T01:35:15.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a03f6b87-4318-436b-b474-c65bd6486e42 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54152024-11-09T01:35:15.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a03f6b87-4318-436b-b474-c65bd6486e42 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54162024-11-09T01:35:15.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a03f6b87-4318-436b-b474-c65bd6486e42 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54172024-11-09T01:35:15.823ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:36703
54182024-11-09T01:35:15.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36703 req_id = 55abd473-78d5-4891-bca7-a4ab45be6945 roles = RoleSet { roles: {} } uri = /metrics/producers
54192024-11-09T01:35:15.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36703 req_id = 55abd473-78d5-4891-bca7-a4ab45be6945 resource = Database result = Ok(()) uri = /metrics/producers
54202024-11-09T01:35:15.835ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = ae2532a5-1acb-4cb0-9e42-a49469d3ac6e
54212024-11-09T01:35:15.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11769 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36703 req_id = 55abd473-78d5-4891-bca7-a4ab45be6945 response_code = 201 uri = /metrics/producers
54222024-11-09T01:35:16.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 994a7928-b385-46d1-929d-c531b0c36efe roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54232024-11-09T01:35:16.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 994a7928-b385-46d1-929d-c531b0c36efe resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54242024-11-09T01:35:16.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 994a7928-b385-46d1-929d-c531b0c36efe response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54252024-11-09T01:35:17.350ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:37445
54262024-11-09T01:35:17.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37445 req_id = d8ea05b8-e278-402e-90f5-0595eb8456eb roles = RoleSet { roles: {} } uri = /metrics/producers
54272024-11-09T01:35:17.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37445 req_id = d8ea05b8-e278-402e-90f5-0595eb8456eb resource = Database result = Ok(()) uri = /metrics/producers
54282024-11-09T01:35:17.359ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = 280d8787-5c87-4881-b4ab-42b6418a5800
54292024-11-09T01:35:17.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9163 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37445 req_id = d8ea05b8-e278-402e-90f5-0595eb8456eb response_code = 201 uri = /metrics/producers
54302024-11-09T01:35:17.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = eb96b97e-22f8-4243-aeed-551498a93775 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54312024-11-09T01:35:17.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = eb96b97e-22f8-4243-aeed-551498a93775 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54322024-11-09T01:35:17.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = eb96b97e-22f8-4243-aeed-551498a93775 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54332024-11-09T01:35:18.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9238e45c-4522-48a1-a81b-3c2b7064374f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54342024-11-09T01:35:18.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9238e45c-4522-48a1-a81b-3c2b7064374f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54352024-11-09T01:35:18.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 9238e45c-4522-48a1-a81b-3c2b7064374f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54362024-11-09T01:35:18.917ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:65087
54372024-11-09T01:35:18.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:65087 req_id = f45c78a0-58b9-4d24-90fe-d40e20327a3b roles = RoleSet { roles: {} } uri = /metrics/producers
54382024-11-09T01:35:18.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:65087 req_id = f45c78a0-58b9-4d24-90fe-d40e20327a3b resource = Database result = Ok(()) uri = /metrics/producers
54392024-11-09T01:35:18.925ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = 48c53f41-2154-4790-bde9-4c822a898bb2
54402024-11-09T01:35:18.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7971 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:65087 req_id = f45c78a0-58b9-4d24-90fe-d40e20327a3b response_code = 201 uri = /metrics/producers
54412024-11-09T01:35:19.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
54422024-11-09T01:35:19.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
54432024-11-09T01:35:19.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54442024-11-09T01:35:19.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54452024-11-09T01:35:19.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54462024-11-09T01:35:19.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54472024-11-09T01:35:19.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54482024-11-09T01:35:19.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54492024-11-09T01:35:19.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54502024-11-09T01:35:19.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54512024-11-09T01:35:19.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54522024-11-09T01:35:19.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54532024-11-09T01:35:19.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54542024-11-09T01:35:19.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
54552024-11-09T01:35:19.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54562024-11-09T01:35:19.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54572024-11-09T01:35:19.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
54582024-11-09T01:35:19.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.396137ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
54592024-11-09T01:35:19.115ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54602024-11-09T01:35:19.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54612024-11-09T01:35:19.151ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.57129ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54622024-11-09T01:35:19.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 736a10c9-293c-409d-811b-be945494bc79 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54632024-11-09T01:35:19.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 736a10c9-293c-409d-811b-be945494bc79 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54642024-11-09T01:35:19.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 736a10c9-293c-409d-811b-be945494bc79 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54652024-11-09T01:35:20.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0da0c201-084b-4411-8c93-d21a660256ee roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54662024-11-09T01:35:20.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0da0c201-084b-4411-8c93-d21a660256ee resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54672024-11-09T01:35:20.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0da0c201-084b-4411-8c93-d21a660256ee response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54682024-11-09T01:35:21.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f2cc34b8-2f05-48a8-b0c8-4b8de1e6b89a roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54692024-11-09T01:35:21.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f2cc34b8-2f05-48a8-b0c8-4b8de1e6b89a resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54702024-11-09T01:35:21.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2556 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f2cc34b8-2f05-48a8-b0c8-4b8de1e6b89a response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54712024-11-09T01:35:22.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a10b34c2-822e-4ae3-8d6a-cbfa5095db51 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54722024-11-09T01:35:22.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a10b34c2-822e-4ae3-8d6a-cbfa5095db51 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54732024-11-09T01:35:22.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2590 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a10b34c2-822e-4ae3-8d6a-cbfa5095db51 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54742024-11-09T01:35:23.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7fc2ae11-3eee-4c14-894f-61c06f0b9056 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54752024-11-09T01:35:23.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7fc2ae11-3eee-4c14-894f-61c06f0b9056 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54762024-11-09T01:35:23.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 7fc2ae11-3eee-4c14-894f-61c06f0b9056 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54772024-11-09T01:35:24.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 487374c2-b1c4-43e8-98d5-9d6aafb5c065 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
54782024-11-09T01:35:24.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 487374c2-b1c4-43e8-98d5-9d6aafb5c065 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
54792024-11-09T01:35:24.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 487374c2-b1c4-43e8-98d5-9d6aafb5c065 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
54802024-11-09T01:35:24.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c5cece7b-340e-4086-988d-33cdab935611 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54812024-11-09T01:35:24.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c5cece7b-340e-4086-988d-33cdab935611 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54822024-11-09T01:35:24.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c5cece7b-340e-4086-988d-33cdab935611 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54832024-11-09T01:35:25.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 153f78a5-4bdc-484f-954d-cf81deed9d41 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54842024-11-09T01:35:25.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 153f78a5-4bdc-484f-954d-cf81deed9d41 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54852024-11-09T01:35:25.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2679 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 153f78a5-4bdc-484f-954d-cf81deed9d41 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54862024-11-09T01:35:26.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 049ca84e-9a45-4cd0-baae-3b02b48212ee roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54872024-11-09T01:35:26.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 049ca84e-9a45-4cd0-baae-3b02b48212ee resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54882024-11-09T01:35:26.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 049ca84e-9a45-4cd0-baae-3b02b48212ee response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54892024-11-09T01:35:27.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 05a2b510-6713-4399-8883-2fde3a040f6f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54902024-11-09T01:35:27.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 05a2b510-6713-4399-8883-2fde3a040f6f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54912024-11-09T01:35:27.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 05a2b510-6713-4399-8883-2fde3a040f6f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54922024-11-09T01:35:29.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f4a0a734-871e-4038-86f5-c37f70e449fe roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54932024-11-09T01:35:29.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f4a0a734-871e-4038-86f5-c37f70e449fe resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54942024-11-09T01:35:29.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2232 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f4a0a734-871e-4038-86f5-c37f70e449fe response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
54952024-11-09T01:35:29.087ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
54962024-11-09T01:35:29.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54972024-11-09T01:35:29.087ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
54982024-11-09T01:35:29.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54992024-11-09T01:35:29.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55002024-11-09T01:35:29.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55012024-11-09T01:35:29.088ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55022024-11-09T01:35:29.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55032024-11-09T01:35:29.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55042024-11-09T01:35:29.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55052024-11-09T01:35:29.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55062024-11-09T01:35:29.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55072024-11-09T01:35:29.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55082024-11-09T01:35:29.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55092024-11-09T01:35:29.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55102024-11-09T01:35:29.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
55112024-11-09T01:35:29.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55122024-11-09T01:35:29.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55132024-11-09T01:35:29.106ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
55142024-11-09T01:35:29.106ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.479107ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
55152024-11-09T01:35:29.116ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.735431ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55162024-11-09T01:35:29.972ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = 318b4dcc-4982-472b-af9a-cacf677005bc response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
55172024-11-09T01:35:30.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 74451931-c4b1-4164-8a05-f7e1ac5cfdd2 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55182024-11-09T01:35:30.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 74451931-c4b1-4164-8a05-f7e1ac5cfdd2 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55192024-11-09T01:35:30.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2700 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 74451931-c4b1-4164-8a05-f7e1ac5cfdd2 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55202024-11-09T01:35:31.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f83d2f56-16af-4b1a-ab9e-efdf26941bbc roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55212024-11-09T01:35:31.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f83d2f56-16af-4b1a-ab9e-efdf26941bbc resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55222024-11-09T01:35:31.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = f83d2f56-16af-4b1a-ab9e-efdf26941bbc response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55232024-11-09T01:35:32.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 10481ad5-bc80-4ae6-ba82-31762906734f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55242024-11-09T01:35:32.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 10481ad5-bc80-4ae6-ba82-31762906734f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55252024-11-09T01:35:32.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 10481ad5-bc80-4ae6-ba82-31762906734f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55262024-11-09T01:35:33.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 1807b6dd-c257-4bcf-94ca-56bb6a14e389 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55272024-11-09T01:35:33.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 1807b6dd-c257-4bcf-94ca-56bb6a14e389 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55282024-11-09T01:35:33.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 1807b6dd-c257-4bcf-94ca-56bb6a14e389 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55292024-11-09T01:35:34.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bfa08e63-5cc0-4fd5-b97b-0cb70f0a886f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55302024-11-09T01:35:34.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bfa08e63-5cc0-4fd5-b97b-0cb70f0a886f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55312024-11-09T01:35:34.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bfa08e63-5cc0-4fd5-b97b-0cb70f0a886f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55322024-11-09T01:35:34.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 5fea8bb2-5a11-4d63-9cd4-c11e329a1173 roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
55332024-11-09T01:35:34.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 5fea8bb2-5a11-4d63-9cd4-c11e329a1173 resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
55342024-11-09T01:35:34.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 5fea8bb2-5a11-4d63-9cd4-c11e329a1173 response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
55352024-11-09T01:35:34.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = e437ff98-dabb-4d18-ba3a-b239c84e76b7 roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
55362024-11-09T01:35:34.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = e437ff98-dabb-4d18-ba3a-b239c84e76b7 resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
55372024-11-09T01:35:34.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = e437ff98-dabb-4d18-ba3a-b239c84e76b7 response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
55382024-11-09T01:35:35.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 80e89989-1b24-40ae-b0b3-c132db7a6f41 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55392024-11-09T01:35:35.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 80e89989-1b24-40ae-b0b3-c132db7a6f41 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55402024-11-09T01:35:35.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 80e89989-1b24-40ae-b0b3-c132db7a6f41 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55412024-11-09T01:35:35.449ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
55422024-11-09T01:35:35.449ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
55432024-11-09T01:35:35.479ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
55442024-11-09T01:35:35.479ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:33504
55452024-11-09T01:35:35.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33504 req_id = 449f9133-a42b-40ed-815d-af5997ca07b6 roles = RoleSet { roles: {} } uri = /metrics/producers
55462024-11-09T01:35:35.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33504 req_id = 449f9133-a42b-40ed-815d-af5997ca07b6 resource = Database result = Ok(()) uri = /metrics/producers
55472024-11-09T01:35:35.489ZINFOnexus: assigned collector to new producer collector_id = c1f5f1ac-115a-4364-9c55-c9fb1352920b file = nexus/src/app/oximeter.rs:76 producer_id = 02562f58-d954-43f9-93a1-2ae8426ccbe9
55482024-11-09T01:35:35.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10698 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33504 req_id = 449f9133-a42b-40ed-815d-af5997ca07b6 response_code = 201 uri = /metrics/producers
55492024-11-09T01:35:35.490ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "449f9133-a42b-40ed-815d-af5997ca07b6", "content-length": "41", "date": "Sat, 09 Nov 2024 01:35:34 GMT"} })
55502024-11-09T01:35:35.490ZDEBGnexus (producer-registration-task): registered with nexus successfully
55512024-11-09T01:35:35.490ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
55522024-11-09T01:35:36.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 62ad21af-3c5a-421f-a870-f3f1d706932e roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55532024-11-09T01:35:36.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 62ad21af-3c5a-421f-a870-f3f1d706932e resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55542024-11-09T01:35:36.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1839 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 62ad21af-3c5a-421f-a870-f3f1d706932e response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55552024-11-09T01:35:37.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 00bc6747-8bc5-4531-b216-a68faa8c941e roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55562024-11-09T01:35:37.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 00bc6747-8bc5-4531-b216-a68faa8c941e resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55572024-11-09T01:35:37.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 00bc6747-8bc5-4531-b216-a68faa8c941e response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55582024-11-09T01:35:38.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 98dea91a-e76d-4581-9f77-61cfa5b1ac20 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55592024-11-09T01:35:38.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 98dea91a-e76d-4581-9f77-61cfa5b1ac20 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55602024-11-09T01:35:38.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2613 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 98dea91a-e76d-4581-9f77-61cfa5b1ac20 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
55612024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
55622024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55632024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
55642024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55652024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
55662024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.32\u{b5}s iteration = 27 status = {"errors":[],"records_set_to_done":[]}
55672024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
55682024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
55692024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
55702024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
55712024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
55722024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
55732024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55742024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
55752024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
55762024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55772024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
55782024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55792024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
55802024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55812024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
55822024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
55832024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55842024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55852024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
55862024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
55872024-11-09T01:35:39.087ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
55882024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55892024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
55902024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
55912024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
55922024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
55932024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
55942024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.38\u{b5}s iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
55952024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
55962024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.03\u{b5}s iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
55972024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
55982024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
55992024-11-09T01:35:39.087ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079
56002024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 8.271\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079"}
56012024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 10.341\u{b5}s iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
56022024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
56032024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
56042024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
56052024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
56062024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56072024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56082024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
56092024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56102024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
56112024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
56122024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
56132024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
56142024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56152024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
56162024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
56172024-11-09T01:35:39.087ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
56182024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
56192024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56202024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
56212024-11-09T01:35:39.087ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 01:25:39.087866145 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
56222024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
56232024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
56242024-11-09T01:35:39.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56252024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56262024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56272024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56282024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56292024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
56302024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56312024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56322024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
56332024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
56342024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56352024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56362024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56372024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56382024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56392024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56402024-11-09T01:35:39.088ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("34219892-cef8-4169-a366-ce17844120f6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("530f76d0-bec9-4ae0-beb0-d217f68ae05a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("530f76d0-bec9-4ae0-beb0-d217f68ae05a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1456, tv_nsec: 107617113 } })
56412024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
56422024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56432024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
56442024-11-09T01:35:39.088ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("30d356ab-a881-4ca3-8f43-203be0381a68.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7f3cd5a1-0f0e-41bf-9ef6-67cae4f139c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d55caa1f-cc37-4ecb-b8bf-58b9052db1d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d55caa1f-cc37-4ecb-b8bf-58b9052db1d9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1456, tv_nsec: 107649533 } })
56452024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
56462024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.038702ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
56472024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
56482024-11-09T01:35:39.088ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.153093ms iteration = 15 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
56492024-11-09T01:35:39.090ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56502024-11-09T01:35:39.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56512024-11-09T01:35:39.091ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.519469ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
56522024-11-09T01:35:39.091ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56532024-11-09T01:35:39.091ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
56542024-11-09T01:35:39.091ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
56552024-11-09T01:35:39.091ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 4.225717ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
56562024-11-09T01:35:39.091ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56572024-11-09T01:35:39.091ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
56582024-11-09T01:35:39.091ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56592024-11-09T01:35:39.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56602024-11-09T01:35:39.093ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
56612024-11-09T01:35:39.093ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56622024-11-09T01:35:39.093ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.992427ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
56632024-11-09T01:35:39.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56642024-11-09T01:35:39.094ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56652024-11-09T01:35:39.095ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56662024-11-09T01:35:39.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56672024-11-09T01:35:39.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56682024-11-09T01:35:39.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
56692024-11-09T01:35:39.096ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
56702024-11-09T01:35:39.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
56712024-11-09T01:35:39.097ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1456, tv_nsec: 116542412 } })
56722024-11-09T01:35:39.097ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
56732024-11-09T01:35:39.098ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56742024-11-09T01:35:39.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56752024-11-09T01:35:39.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56762024-11-09T01:35:39.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56772024-11-09T01:35:39.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56782024-11-09T01:35:39.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
56792024-11-09T01:35:39.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56802024-11-09T01:35:39.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56812024-11-09T01:35:39.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56822024-11-09T01:35:39.102ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1456, tv_nsec: 122244156 } })
56832024-11-09T01:35:39.103ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
56842024-11-09T01:35:39.104ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56852024-11-09T01:35:39.104ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
56862024-11-09T01:35:39.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56872024-11-09T01:35:39.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56882024-11-09T01:35:39.105ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 01:25:39.087866145 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
56892024-11-09T01:35:39.105ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 17.154171ms iteration = 14 status = {"expiration":"2024-11-09T01:25:39.087866145Z","pruned":[]}
56902024-11-09T01:35:39.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56912024-11-09T01:35:39.107ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56922024-11-09T01:35:39.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56932024-11-09T01:35:39.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56942024-11-09T01:35:39.110ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56952024-11-09T01:35:39.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
56962024-11-09T01:35:39.113ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56972024-11-09T01:35:39.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56982024-11-09T01:35:39.113ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
56992024-11-09T01:35:39.113ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 26.148092ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
57002024-11-09T01:35:39.133ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57012024-11-09T01:35:39.133ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57022024-11-09T01:35:39.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57032024-11-09T01:35:39.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57042024-11-09T01:35:39.135ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57052024-11-09T01:35:39.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57062024-11-09T01:35:39.136ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
57072024-11-09T01:35:39.136ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57082024-11-09T01:35:39.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
57092024-11-09T01:35:39.136ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 48.660492ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57102024-11-09T01:35:39.138ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57112024-11-09T01:35:39.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57122024-11-09T01:35:39.139ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57132024-11-09T01:35:39.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57142024-11-09T01:35:39.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
57152024-11-09T01:35:39.139ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57162024-11-09T01:35:39.139ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57172024-11-09T01:35:39.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57182024-11-09T01:35:39.140ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57192024-11-09T01:35:39.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
57202024-11-09T01:35:39.143ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57212024-11-09T01:35:39.143ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57222024-11-09T01:35:39.143ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57232024-11-09T01:35:39.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57242024-11-09T01:35:39.144ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57252024-11-09T01:35:39.144ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57262024-11-09T01:35:39.144ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
57272024-11-09T01:35:39.144ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 56.942355ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
57282024-11-09T01:35:39.145ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1456, tv_nsec: 164756900 } })
57292024-11-09T01:35:39.145ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
57302024-11-09T01:35:39.145ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57312024-11-09T01:35:39.146ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57322024-11-09T01:35:39.146ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57332024-11-09T01:35:39.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57342024-11-09T01:35:39.146ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57352024-11-09T01:35:39.146ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57362024-11-09T01:35:39.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57372024-11-09T01:35:39.147ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57382024-11-09T01:35:39.147ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
57392024-11-09T01:35:39.147ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
57402024-11-09T01:35:39.147ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 59.877707ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
57412024-11-09T01:35:39.149ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57422024-11-09T01:35:39.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57432024-11-09T01:35:39.149ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
57442024-11-09T01:35:39.150ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
57452024-11-09T01:35:39.150ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57462024-11-09T01:35:39.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57472024-11-09T01:35:39.153ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57482024-11-09T01:35:39.156ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57492024-11-09T01:35:39.156ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57502024-11-09T01:35:39.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57512024-11-09T01:35:39.159ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57522024-11-09T01:35:39.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57532024-11-09T01:35:39.160ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57542024-11-09T01:35:39.163ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
57552024-11-09T01:35:39.163ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57562024-11-09T01:35:39.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57572024-11-09T01:35:39.169ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
57582024-11-09T01:35:39.169ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.731181ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
57592024-11-09T01:35:39.175ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57602024-11-09T01:35:39.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57612024-11-09T01:35:39.178ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57622024-11-09T01:35:39.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57632024-11-09T01:35:39.179ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
57642024-11-09T01:35:39.179ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
57652024-11-09T01:35:39.179ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
57662024-11-09T01:35:39.179ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57672024-11-09T01:35:39.179ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.31173ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57682024-11-09T01:35:39.180ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57692024-11-09T01:35:39.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57702024-11-09T01:35:39.181ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57712024-11-09T01:35:39.181ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
57722024-11-09T01:35:39.181ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
57732024-11-09T01:35:39.181ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
57742024-11-09T01:35:39.181ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57752024-11-09T01:35:39.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57762024-11-09T01:35:39.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c24f6fb-cc5e-4758-a216-4357bbb5d813, lookup_type: ById(8c24f6fb-cc5e-4758-a216-4357bbb5d813) } result = Ok(())
57772024-11-09T01:35:39.183ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57782024-11-09T01:35:39.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57792024-11-09T01:35:39.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
57802024-11-09T01:35:39.184ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57812024-11-09T01:35:39.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57822024-11-09T01:35:39.185ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57832024-11-09T01:35:39.186ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 99.188656ms iteration = 27 status = 0
57842024-11-09T01:35:39.188ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
57852024-11-09T01:35:39.188ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57862024-11-09T01:35:39.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57872024-11-09T01:35:39.209ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T01:22:35.233443Z, time_modified: 2024-11-09T01:22:35.233443Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 539ccef2-8207-42b1-9e05-00e0a1387c35, db_silo: Silo { identity: SiloIdentity { id: 539ccef2-8207-42b1-9e05-00e0a1387c35, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T01:23:03.926223Z, time_modified: 2024-11-09T01:23:03.926223Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 539ccef2-8207-42b1-9e05-00e0a1387c35, db_silo: Silo { identity: SiloIdentity { id: 539ccef2-8207-42b1-9e05-00e0a1387c35, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T01:23:03.926223Z, time_modified: 2024-11-09T01:23:03.926223Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248" }] }) }
57882024-11-09T01:35:39.209ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 122.187442ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"539ccef2-8207-42b1-9e05-00e0a1387c35","tls_certs":["22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248"]}},"default_endpoint":{"silo_id":"539ccef2-8207-42b1-9e05-00e0a1387c35","tls_certs":["22c9c84ce0857e6566583baef805f8579f961f9f842899eba55e4e3ddf722248"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
57892024-11-09T01:35:39.217ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57902024-11-09T01:35:39.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57912024-11-09T01:35:39.219ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57922024-11-09T01:35:39.221ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57932024-11-09T01:35:39.221ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57942024-11-09T01:35:39.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57952024-11-09T01:35:39.223ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57962024-11-09T01:35:39.225ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57972024-11-09T01:35:39.225ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57982024-11-09T01:35:39.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57992024-11-09T01:35:39.230ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
58002024-11-09T01:35:39.230ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 72269a3a-73dc-4fb3-8a06-f7b406523664 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
58012024-11-09T01:35:39.230ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58022024-11-09T01:35:39.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58032024-11-09T01:35:39.232ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58042024-11-09T01:35:39.235ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
58052024-11-09T01:35:39.235ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = dadc16e6-e16c-4c3f-bb19-4f189e9d1c26 dns_zone_name = oxide.test found_so_far = 0 version = 2
58062024-11-09T01:35:39.235ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58072024-11-09T01:35:39.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58082024-11-09T01:35:39.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58092024-11-09T01:35:39.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58102024-11-09T01:35:39.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58112024-11-09T01:35:39.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58122024-11-09T01:35:39.238ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
58132024-11-09T01:35:39.238ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
58142024-11-09T01:35:39.238ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58152024-11-09T01:35:39.238ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9e92697-da21-461b-8b8c-076df30c533d", "content-length": "26", "date": "Sat, 09 Nov 2024 01:35:39 GMT"} })
58162024-11-09T01:35:39.238ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58172024-11-09T01:35:39.239ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
58182024-11-09T01:35:39.239ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 151.58068ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
58192024-11-09T01:35:39.239ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 72269a3a-73dc-4fb3-8a06-f7b406523664 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
58202024-11-09T01:35:39.239ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
58212024-11-09T01:35:39.239ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 01:23:03.098267 UTC dns_group = internal generation = 1
58222024-11-09T01:35:39.239ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 151.881793ms iteration = 15 status = {"generation":1}
58232024-11-09T01:35:39.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58242024-11-09T01:35:39.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58252024-11-09T01:35:39.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58262024-11-09T01:35:39.240ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58272024-11-09T01:35:39.242ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = dadc16e6-e16c-4c3f-bb19-4f189e9d1c26 dns_zone_name = oxide.test found_so_far = 1 version = 2
58282024-11-09T01:35:39.242ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
58292024-11-09T01:35:39.242ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 01:23:03.974860 UTC dns_group = external generation = 2
58302024-11-09T01:35:39.242ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 154.513703ms iteration = 15 status = {"generation":2}
58312024-11-09T01:35:39.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 88d26bb7-ae4d-4711-8c6f-22f9d22d410c roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
58322024-11-09T01:35:39.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 88d26bb7-ae4d-4711-8c6f-22f9d22d410c resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
58332024-11-09T01:35:39.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 88d26bb7-ae4d-4711-8c6f-22f9d22d410c response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
58342024-11-09T01:35:39.256ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 168.892264ms iteration = 31 status = {"physical_disks_added":0}
58352024-11-09T01:35:39.292ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba zone_address = fd00:1122:3344:101::2
58362024-11-09T01:35:39.292ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58372024-11-09T01:35:39.293ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "23d31300-55da-4c06-a9eb-6c8f77dcb32e", "content-length": "26", "date": "Sat, 09 Nov 2024 01:35:39 GMT"} })
58382024-11-09T01:35:39.293ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58392024-11-09T01:35:39.295ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
58402024-11-09T01:35:39.367ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
58412024-11-09T01:35:39.382ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
58422024-11-09T01:35:39.382ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58432024-11-09T01:35:39.382ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a26c0bff-aad5-461b-820c-252e9748caa4", "content-length": "26", "date": "Sat, 09 Nov 2024 01:35:39 GMT"} })
58442024-11-09T01:35:39.382ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58452024-11-09T01:35:39.384ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58462024-11-09T01:35:39.405ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 317.592601ms iteration = 27 status = {}
58472024-11-09T01:35:39.429ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
58482024-11-09T01:35:39.429ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58492024-11-09T01:35:39.429ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc099b4e-31dd-4114-990e-dcde0faedc26", "content-length": "372", "date": "Sat, 09 Nov 2024 01:35:39 GMT"} })
58502024-11-09T01:35:39.429ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58512024-11-09T01:35:39.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58522024-11-09T01:35:39.462ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
58532024-11-09T01:35:39.462ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfd365ad-3707-4535-9218-ac215eb252bd", "content-length": "691", "date": "Sat, 09 Nov 2024 01:35:39 GMT"} })
58542024-11-09T01:35:39.462ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
58552024-11-09T01:35:39.462ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
58562024-11-09T01:35:39.462ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
58572024-11-09T01:35:39.464ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 376.968713ms iteration = 28 status = {}
58582024-11-09T01:35:39.470ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
58592024-11-09T01:35:39.470ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
58602024-11-09T01:35:39.470ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "688d226e-de9f-489a-806f-f7aa7186da91", "date": "Sat, 09 Nov 2024 01:35:39 GMT"} })
58612024-11-09T01:35:39.470ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58622024-11-09T01:35:39.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58632024-11-09T01:35:39.472ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58642024-11-09T01:35:39.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58652024-11-09T01:35:39.475ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58662024-11-09T01:35:39.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58672024-11-09T01:35:39.479ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
58682024-11-09T01:35:39.479ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58692024-11-09T01:35:39.479ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "461efd82-e753-4a12-b919-60f6518290c6", "date": "Sat, 09 Nov 2024 01:35:39 GMT"} })
58702024-11-09T01:35:39.481ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 393.510257ms iteration = 29 status = {}
58712024-11-09T01:35:39.513ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
58722024-11-09T01:35:39.513ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "26e4081a-096f-45c9-afd1-73df763dd842", "content-length": "2", "date": "Sat, 09 Nov 2024 01:35:39 GMT"} })
58732024-11-09T01:35:39.515ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
58742024-11-09T01:35:39.515ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58752024-11-09T01:35:39.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58762024-11-09T01:35:39.517ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 429.800272ms iteration = 27 status = null
58772024-11-09T01:35:39.517ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
58782024-11-09T01:35:39.518ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8ded7f2c-9ff0-4576-a91f-395a940216ce", "date": "Sat, 09 Nov 2024 01:35:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
58792024-11-09T01:35:39.518ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
58802024-11-09T01:35:39.520ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "46ee7052-c117-4fc7-b286-5dfb6e200e4f", "date": "Sat, 09 Nov 2024 01:35:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
58812024-11-09T01:35:39.520ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
58822024-11-09T01:35:39.522ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
58832024-11-09T01:35:39.522ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 434.297902ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
58842024-11-09T01:35:39.576ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
58852024-11-09T01:35:39.577ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "506fdc25-742d-4861-ada2-4e10354ddcf7", "date": "Sat, 09 Nov 2024 01:35:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
58862024-11-09T01:35:39.577ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
58872024-11-09T01:35:39.578ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "eeafebc7-2e8c-4f83-8845-1ec26770c4ae", "date": "Sat, 09 Nov 2024 01:35:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
58882024-11-09T01:35:39.578ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
58892024-11-09T01:35:39.580ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "59f5488c-41e4-4adc-beff-1b7d9623f4c1", "date": "Sat, 09 Nov 2024 01:35:39 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
58902024-11-09T01:35:39.580ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
58912024-11-09T01:35:39.585ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
58922024-11-09T01:35:39.585ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 497.417276ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
58932024-11-09T01:35:39.626ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58942024-11-09T01:35:39.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58952024-11-09T01:35:39.628ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 68cb9c64-43d4-4c3f-ba7b-013513b8c68d, rack_id: 54080907-d4a8-4f65-b867-da4e2da6d2ba, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8166ae85-b9fa-427c-9f22-e997378e0527) } rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
58962024-11-09T01:35:39.628ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58972024-11-09T01:35:39.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58982024-11-09T01:35:39.639ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
58992024-11-09T01:35:39.640ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "22cd19ae-8ab0-4090-8c23-2c588446f62e", "content-length": "134", "date": "Sat, 09 Nov 2024 01:35:39 GMT"} })
59002024-11-09T01:35:39.640ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
59012024-11-09T01:35:39.640ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8166ae85-b9fa-427c-9f22-e997378e0527
59022024-11-09T01:35:39.640ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
59032024-11-09T01:35:39.640ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
59042024-11-09T01:35:39.640ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59052024-11-09T01:35:39.640ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59062024-11-09T01:35:39.640ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59072024-11-09T01:35:39.640ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59082024-11-09T01:35:39.640ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59092024-11-09T01:35:39.640ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59102024-11-09T01:35:39.641ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
59112024-11-09T01:35:39.641ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59122024-11-09T01:35:39.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59132024-11-09T01:35:39.647ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
59142024-11-09T01:35:39.647ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "24f626c1-5832-4716-9c69-126037673c1c", "content-length": "2", "date": "Sat, 09 Nov 2024 01:35:39 GMT"} })
59152024-11-09T01:35:39.647ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
59162024-11-09T01:35:39.647ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c354a10-65b9-427c-a5ac-3e240c3a50bb", "content-length": "52", "date": "Sat, 09 Nov 2024 01:35:39 GMT"} })
59172024-11-09T01:35:39.647ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
59182024-11-09T01:35:39.647ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
59192024-11-09T01:35:39.769ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0908f83c-4f9d-418d-b871-d84de6e4a7c4", "date": "Sat, 09 Nov 2024 01:35:39 GMT"} })
59202024-11-09T01:35:39.769ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch = Switch0
59212024-11-09T01:35:39.769ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
59222024-11-09T01:35:39.770ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "581c34d8-af0e-4fda-911b-ac747251da2b", "content-length": "682", "date": "Sat, 09 Nov 2024 01:35:39 GMT"} })
59232024-11-09T01:35:39.770ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59242024-11-09T01:35:39.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59252024-11-09T01:35:39.774ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59262024-11-09T01:35:39.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59272024-11-09T01:35:39.779ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59282024-11-09T01:35:39.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59292024-11-09T01:35:39.782ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59302024-11-09T01:35:39.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59312024-11-09T01:35:39.789ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 701.898996ms iteration = 27 status = {}
59322024-11-09T01:35:40.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a8c350fe-a4a8-4f14-bd98-268bdbf07a77 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59332024-11-09T01:35:40.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a8c350fe-a4a8-4f14-bd98-268bdbf07a77 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59342024-11-09T01:35:40.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2091 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a8c350fe-a4a8-4f14-bd98-268bdbf07a77 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59352024-11-09T01:35:41.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b20bea80-e1ad-4772-b058-c5fbd815b14c roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59362024-11-09T01:35:41.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b20bea80-e1ad-4772-b058-c5fbd815b14c resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59372024-11-09T01:35:41.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b20bea80-e1ad-4772-b058-c5fbd815b14c response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59382024-11-09T01:35:42.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 37cb347c-ab81-4110-bf3d-3148e9b5e3e5 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59392024-11-09T01:35:42.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 37cb347c-ab81-4110-bf3d-3148e9b5e3e5 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59402024-11-09T01:35:42.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2815 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 37cb347c-ab81-4110-bf3d-3148e9b5e3e5 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59412024-11-09T01:35:43.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c6a4eb2a-74fb-4486-bd3a-1c59c3ec930f roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59422024-11-09T01:35:43.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c6a4eb2a-74fb-4486-bd3a-1c59c3ec930f resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59432024-11-09T01:35:43.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2665 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = c6a4eb2a-74fb-4486-bd3a-1c59c3ec930f response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59442024-11-09T01:35:44.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5de403ba-ce64-4c30-b17c-d46718ba8962 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59452024-11-09T01:35:44.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5de403ba-ce64-4c30-b17c-d46718ba8962 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59462024-11-09T01:35:44.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5de403ba-ce64-4c30-b17c-d46718ba8962 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59472024-11-09T01:35:44.972ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1511 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = a9e4b5c8-1bfc-40f2-bfe8-dc34f793a07a response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
59482024-11-09T01:35:45.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 173ed2c4-fb9b-440d-bebf-692f9fdd371d roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59492024-11-09T01:35:45.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 173ed2c4-fb9b-440d-bebf-692f9fdd371d resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59502024-11-09T01:35:45.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 173ed2c4-fb9b-440d-bebf-692f9fdd371d response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59512024-11-09T01:35:46.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 96b8ada7-509e-4f8b-85b7-293b3a8e6573 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59522024-11-09T01:35:46.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 96b8ada7-509e-4f8b-85b7-293b3a8e6573 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59532024-11-09T01:35:46.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2407 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 96b8ada7-509e-4f8b-85b7-293b3a8e6573 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59542024-11-09T01:35:47.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 55bac7ba-5931-45d5-a7b0-99e24f1882c7 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59552024-11-09T01:35:47.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 55bac7ba-5931-45d5-a7b0-99e24f1882c7 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59562024-11-09T01:35:47.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 55bac7ba-5931-45d5-a7b0-99e24f1882c7 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59572024-11-09T01:35:48.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = dc13fb37-043e-4e3b-bdc8-47c81a0d6c6b roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59582024-11-09T01:35:48.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = dc13fb37-043e-4e3b-bdc8-47c81a0d6c6b resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59592024-11-09T01:35:48.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2705 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = dc13fb37-043e-4e3b-bdc8-47c81a0d6c6b response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59602024-11-09T01:35:49.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
59612024-11-09T01:35:49.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
59622024-11-09T01:35:49.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59632024-11-09T01:35:49.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59642024-11-09T01:35:49.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59652024-11-09T01:35:49.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59662024-11-09T01:35:49.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59672024-11-09T01:35:49.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59682024-11-09T01:35:49.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59692024-11-09T01:35:49.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59702024-11-09T01:35:49.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59712024-11-09T01:35:49.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59722024-11-09T01:35:49.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59732024-11-09T01:35:49.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
59742024-11-09T01:35:49.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59752024-11-09T01:35:49.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59762024-11-09T01:35:49.110ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
59772024-11-09T01:35:49.110ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.909996ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
59782024-11-09T01:35:49.115ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59792024-11-09T01:35:49.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59802024-11-09T01:35:49.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.176917ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59812024-11-09T01:35:49.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4ee17245-094e-4019-b64c-c1db4e530e3a roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59822024-11-09T01:35:49.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4ee17245-094e-4019-b64c-c1db4e530e3a resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59832024-11-09T01:35:49.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4ee17245-094e-4019-b64c-c1db4e530e3a response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59842024-11-09T01:35:49.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = bf28ada6-e092-47cc-bed5-0d4585d1c7cf roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
59852024-11-09T01:35:49.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = bf28ada6-e092-47cc-bed5-0d4585d1c7cf resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
59862024-11-09T01:35:49.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3673 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = bf28ada6-e092-47cc-bed5-0d4585d1c7cf response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
59872024-11-09T01:35:49.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 3578179d-db74-40ed-9809-63915d550f27 roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
59882024-11-09T01:35:49.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 3578179d-db74-40ed-9809-63915d550f27 resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
59892024-11-09T01:35:49.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = 3578179d-db74-40ed-9809-63915d550f27 response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
59902024-11-09T01:35:50.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4e2b3c70-0e75-428e-8844-41db063f14af roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59912024-11-09T01:35:50.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4e2b3c70-0e75-428e-8844-41db063f14af resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59922024-11-09T01:35:50.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2711 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4e2b3c70-0e75-428e-8844-41db063f14af response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59932024-11-09T01:35:51.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bec2a643-cc9c-4277-acd9-33cc01801810 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59942024-11-09T01:35:51.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bec2a643-cc9c-4277-acd9-33cc01801810 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59952024-11-09T01:35:51.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2681 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = bec2a643-cc9c-4277-acd9-33cc01801810 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59962024-11-09T01:35:52.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e357ca61-71f2-4be9-b7bb-8717d39b48ff roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59972024-11-09T01:35:52.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e357ca61-71f2-4be9-b7bb-8717d39b48ff resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59982024-11-09T01:35:52.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e357ca61-71f2-4be9-b7bb-8717d39b48ff response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
59992024-11-09T01:35:53.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d56a1b08-4dc8-4373-8e45-bad458f05d80 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60002024-11-09T01:35:53.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d56a1b08-4dc8-4373-8e45-bad458f05d80 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60012024-11-09T01:35:53.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2902 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d56a1b08-4dc8-4373-8e45-bad458f05d80 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60022024-11-09T01:35:54.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 4ab86ba2-9a13-4487-bd03-a91f3c357a21 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
60032024-11-09T01:35:54.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 4ab86ba2-9a13-4487-bd03-a91f3c357a21 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
60042024-11-09T01:35:54.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 4ab86ba2-9a13-4487-bd03-a91f3c357a21 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
60052024-11-09T01:35:54.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 87281d92-5a84-4465-b28d-da02324230ef roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60062024-11-09T01:35:54.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 87281d92-5a84-4465-b28d-da02324230ef resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60072024-11-09T01:35:54.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2584 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 87281d92-5a84-4465-b28d-da02324230ef response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60082024-11-09T01:35:55.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3b7e8b95-dd9b-410b-9d87-c8c5f8bdb680 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60092024-11-09T01:35:55.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3b7e8b95-dd9b-410b-9d87-c8c5f8bdb680 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60102024-11-09T01:35:55.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2843 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3b7e8b95-dd9b-410b-9d87-c8c5f8bdb680 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60112024-11-09T01:35:56.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b16c09cb-9f5c-472c-b3d7-fc98800c2993 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60122024-11-09T01:35:56.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b16c09cb-9f5c-472c-b3d7-fc98800c2993 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60132024-11-09T01:35:56.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1826 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b16c09cb-9f5c-472c-b3d7-fc98800c2993 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60142024-11-09T01:35:57.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 640c01e6-dbae-44fc-be64-24742cd7f83b roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60152024-11-09T01:35:57.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 640c01e6-dbae-44fc-be64-24742cd7f83b resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60162024-11-09T01:35:57.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 640c01e6-dbae-44fc-be64-24742cd7f83b response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60172024-11-09T01:35:58.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6b172bc6-7a02-4c26-882a-a61323edabb4 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60182024-11-09T01:35:58.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6b172bc6-7a02-4c26-882a-a61323edabb4 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60192024-11-09T01:35:58.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2128 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6b172bc6-7a02-4c26-882a-a61323edabb4 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60202024-11-09T01:35:59.087ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
60212024-11-09T01:35:59.087ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
60222024-11-09T01:35:59.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60232024-11-09T01:35:59.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60242024-11-09T01:35:59.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60252024-11-09T01:35:59.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60262024-11-09T01:35:59.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60272024-11-09T01:35:59.089ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60282024-11-09T01:35:59.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60292024-11-09T01:35:59.091ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.466259ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60302024-11-09T01:35:59.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60312024-11-09T01:35:59.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60322024-11-09T01:35:59.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60332024-11-09T01:35:59.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60342024-11-09T01:35:59.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60352024-11-09T01:35:59.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60362024-11-09T01:35:59.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
60372024-11-09T01:35:59.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60382024-11-09T01:35:59.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60392024-11-09T01:35:59.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
60402024-11-09T01:35:59.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.509848ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
60412024-11-09T01:35:59.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 470e0203-3a04-4989-b524-1b48b92878ee roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60422024-11-09T01:35:59.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 470e0203-3a04-4989-b524-1b48b92878ee resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60432024-11-09T01:35:59.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1946 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 470e0203-3a04-4989-b524-1b48b92878ee response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60442024-11-09T01:35:59.973ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1793 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = bb1a5b36-6e1e-4044-b270-33b035bcdce6 response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
60452024-11-09T01:36:00.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 79ab66dd-c50b-41fd-bf6c-452316022738 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60462024-11-09T01:36:00.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 79ab66dd-c50b-41fd-bf6c-452316022738 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60472024-11-09T01:36:00.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 79ab66dd-c50b-41fd-bf6c-452316022738 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60482024-11-09T01:36:01.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a0274089-cd7b-493d-8822-9499cd30add2 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60492024-11-09T01:36:01.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a0274089-cd7b-493d-8822-9499cd30add2 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60502024-11-09T01:36:01.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2805 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = a0274089-cd7b-493d-8822-9499cd30add2 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60512024-11-09T01:36:02.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 99b92c0c-0e08-4615-af5d-54b827459715 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60522024-11-09T01:36:02.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 99b92c0c-0e08-4615-af5d-54b827459715 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60532024-11-09T01:36:02.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 99b92c0c-0e08-4615-af5d-54b827459715 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60542024-11-09T01:36:03.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0f3813b4-325d-41d6-b813-c7a299c0dfa2 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60552024-11-09T01:36:03.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0f3813b4-325d-41d6-b813-c7a299c0dfa2 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60562024-11-09T01:36:03.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2498 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0f3813b4-325d-41d6-b813-c7a299c0dfa2 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60572024-11-09T01:36:04.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0b63a339-9ecd-4365-b64a-8001b7570f3d roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60582024-11-09T01:36:04.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0b63a339-9ecd-4365-b64a-8001b7570f3d resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60592024-11-09T01:36:04.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 0b63a339-9ecd-4365-b64a-8001b7570f3d response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60602024-11-09T01:36:05.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e8b5bebf-6a6b-43d7-af30-fe0c26283d85 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60612024-11-09T01:36:05.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e8b5bebf-6a6b-43d7-af30-fe0c26283d85 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60622024-11-09T01:36:05.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = e8b5bebf-6a6b-43d7-af30-fe0c26283d85 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60632024-11-09T01:36:06.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 15448388-5291-4f57-a3cc-53e2f78fa1fe roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60642024-11-09T01:36:06.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 15448388-5291-4f57-a3cc-53e2f78fa1fe resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60652024-11-09T01:36:06.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2383 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 15448388-5291-4f57-a3cc-53e2f78fa1fe response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60662024-11-09T01:36:08.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5eea7daa-50da-4df2-8586-20420aed9ac5 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60672024-11-09T01:36:08.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5eea7daa-50da-4df2-8586-20420aed9ac5 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60682024-11-09T01:36:08.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 5eea7daa-50da-4df2-8586-20420aed9ac5 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60692024-11-09T01:36:09.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 41910892-ac46-497f-921c-4ce9185b33bf roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60702024-11-09T01:36:09.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 41910892-ac46-497f-921c-4ce9185b33bf resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60712024-11-09T01:36:09.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2681 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 41910892-ac46-497f-921c-4ce9185b33bf response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
60722024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
60732024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
60742024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
60752024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
60762024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60772024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60782024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
60792024-11-09T01:36:09.087ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
60802024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
60812024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60822024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60832024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
60842024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
60852024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60862024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
60872024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
60882024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
60892024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60902024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
60912024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
60922024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60932024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60942024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60952024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
60962024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60972024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
60982024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60992024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
61002024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61012024-11-09T01:36:09.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61022024-11-09T01:36:09.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61032024-11-09T01:36:09.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61042024-11-09T01:36:09.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61052024-11-09T01:36:09.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61062024-11-09T01:36:09.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61072024-11-09T01:36:09.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61082024-11-09T01:36:09.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61092024-11-09T01:36:09.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61102024-11-09T01:36:09.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61112024-11-09T01:36:09.088ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
61122024-11-09T01:36:09.088ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
61132024-11-09T01:36:09.088ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
61142024-11-09T01:36:09.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 7.43\u{b5}s iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
61152024-11-09T01:36:09.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.97\u{b5}s iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
61162024-11-09T01:36:09.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 15.971\u{b5}s iteration = 28 status = {"errors":[],"records_set_to_done":[]}
61172024-11-09T01:36:09.088ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
61182024-11-09T01:36:09.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.69\u{b5}s iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
61192024-11-09T01:36:09.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61202024-11-09T01:36:09.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61212024-11-09T01:36:09.090ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1486, tv_nsec: 109599925 } })
61222024-11-09T01:36:09.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61232024-11-09T01:36:09.090ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
61242024-11-09T01:36:09.091ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.701862ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
61252024-11-09T01:36:09.091ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1486, tv_nsec: 110446464 } })
61262024-11-09T01:36:09.091ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
61272024-11-09T01:36:09.091ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61282024-11-09T01:36:09.093ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61292024-11-09T01:36:09.093ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61302024-11-09T01:36:09.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61312024-11-09T01:36:09.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
61322024-11-09T01:36:09.094ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61332024-11-09T01:36:09.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61342024-11-09T01:36:09.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61352024-11-09T01:36:09.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61362024-11-09T01:36:09.096ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61372024-11-09T01:36:09.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
61382024-11-09T01:36:09.096ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61392024-11-09T01:36:09.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61402024-11-09T01:36:09.096ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 9.400465ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61412024-11-09T01:36:09.097ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61422024-11-09T01:36:09.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61432024-11-09T01:36:09.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61442024-11-09T01:36:09.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61452024-11-09T01:36:09.099ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61462024-11-09T01:36:09.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61472024-11-09T01:36:09.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61482024-11-09T01:36:09.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
61492024-11-09T01:36:09.103ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61502024-11-09T01:36:09.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61512024-11-09T01:36:09.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61522024-11-09T01:36:09.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61532024-11-09T01:36:09.105ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8c24f6fb-cc5e-4758-a216-4357bbb5d813.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1486, tv_nsec: 124522591 } })
61542024-11-09T01:36:09.105ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
61552024-11-09T01:36:09.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61562024-11-09T01:36:09.106ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61572024-11-09T01:36:09.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61582024-11-09T01:36:09.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
61592024-11-09T01:36:09.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61602024-11-09T01:36:09.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61612024-11-09T01:36:09.122ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
61622024-11-09T01:36:09.122ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 34.409144ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
61632024-11-09T01:36:09.126ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61642024-11-09T01:36:09.126ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
61652024-11-09T01:36:09.126ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61662024-11-09T01:36:09.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61672024-11-09T01:36:09.128ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61682024-11-09T01:36:09.129ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61692024-11-09T01:36:09.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61702024-11-09T01:36:09.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61712024-11-09T01:36:09.130ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61722024-11-09T01:36:09.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61732024-11-09T01:36:09.131ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61742024-11-09T01:36:09.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61752024-11-09T01:36:09.132ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61762024-11-09T01:36:09.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61772024-11-09T01:36:09.133ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 45.697699ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61782024-11-09T01:36:09.133ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61792024-11-09T01:36:09.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61802024-11-09T01:36:09.134ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61812024-11-09T01:36:09.135ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61822024-11-09T01:36:09.135ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
61832024-11-09T01:36:09.135ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 47.783243ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
61842024-11-09T01:36:09.136ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61852024-11-09T01:36:09.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61862024-11-09T01:36:09.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8c24f6fb-cc5e-4758-a216-4357bbb5d813, lookup_type: ById(8c24f6fb-cc5e-4758-a216-4357bbb5d813) } result = Ok(())
61872024-11-09T01:36:09.137ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61882024-11-09T01:36:09.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61892024-11-09T01:36:09.137ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61902024-11-09T01:36:09.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61912024-11-09T01:36:09.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61922024-11-09T01:36:09.139ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 52.00025ms iteration = 28 status = 0
61932024-11-09T01:36:09.155ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61942024-11-09T01:36:09.155ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
61952024-11-09T01:36:09.155ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61962024-11-09T01:36:09.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61972024-11-09T01:36:09.173ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61982024-11-09T01:36:09.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61992024-11-09T01:36:09.175ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62002024-11-09T01:36:09.177ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62012024-11-09T01:36:09.177ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62022024-11-09T01:36:09.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62032024-11-09T01:36:09.179ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62042024-11-09T01:36:09.181ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62052024-11-09T01:36:09.181ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62062024-11-09T01:36:09.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62072024-11-09T01:36:09.184ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 96.610917ms iteration = 32 status = {"physical_disks_added":0}
62082024-11-09T01:36:09.184ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62092024-11-09T01:36:09.184ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
62102024-11-09T01:36:09.184ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 96.954151ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
62112024-11-09T01:36:09.194ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba zone_address = fd00:1122:3344:101::2
62122024-11-09T01:36:09.194ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62132024-11-09T01:36:09.194ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7bdddb0-16b3-4e9c-85fb-a476c655d75b", "content-length": "26", "date": "Sat, 09 Nov 2024 01:36:09 GMT"} })
62142024-11-09T01:36:09.194ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62152024-11-09T01:36:09.196ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
62162024-11-09T01:36:09.276ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
62172024-11-09T01:36:09.276ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62182024-11-09T01:36:09.276ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "56e16969-5fd6-40d0-9736-ed926c0f9190", "content-length": "26", "date": "Sat, 09 Nov 2024 01:36:09 GMT"} })
62192024-11-09T01:36:09.276ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62202024-11-09T01:36:09.278ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62212024-11-09T01:36:09.288ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
62222024-11-09T01:36:09.288ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62232024-11-09T01:36:09.288ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "517b7173-1191-4281-a8d0-166a049cc7ff", "content-length": "26", "date": "Sat, 09 Nov 2024 01:36:09 GMT"} })
62242024-11-09T01:36:09.288ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62252024-11-09T01:36:09.289ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62262024-11-09T01:36:09.323ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
62272024-11-09T01:36:09.323ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62282024-11-09T01:36:09.324ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5bb527a-4e05-42a5-966e-661e7f739033", "content-length": "372", "date": "Sat, 09 Nov 2024 01:36:09 GMT"} })
62292024-11-09T01:36:09.324ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62302024-11-09T01:36:09.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62312024-11-09T01:36:09.365ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
62322024-11-09T01:36:09.365ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
62332024-11-09T01:36:09.365ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8ccdc078-9318-41cd-acda-f98de1907303", "date": "Sat, 09 Nov 2024 01:36:09 GMT"} })
62342024-11-09T01:36:09.365ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62352024-11-09T01:36:09.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62362024-11-09T01:36:09.368ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62372024-11-09T01:36:09.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62382024-11-09T01:36:09.370ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62392024-11-09T01:36:09.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62402024-11-09T01:36:09.374ZINFOnexus (BackgroundTasks): VPC route manager sled 8c24f6fb-cc5e-4758-a216-4357bbb5d813 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
62412024-11-09T01:36:09.374ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62422024-11-09T01:36:09.374ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9da9bd4c-970a-4f5d-b5be-1a2f36e6aaf1", "date": "Sat, 09 Nov 2024 01:36:09 GMT"} })
62432024-11-09T01:36:09.376ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 288.744349ms iteration = 30 status = {}
62442024-11-09T01:36:09.400ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
62452024-11-09T01:36:09.400ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "505f9ca5-7ad1-4df0-9420-db77f75ab185", "content-length": "2", "date": "Sat, 09 Nov 2024 01:36:09 GMT"} })
62462024-11-09T01:36:09.401ZDEBGnexus (BackgroundTasks): client request SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
62472024-11-09T01:36:09.401ZDEBGnexus (BackgroundTasks): client response SledAgent = 8c24f6fb-cc5e-4758-a216-4357bbb5d813 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9eb5b33a-d77b-4b1a-a71a-6924fb8c3a2f", "content-length": "691", "date": "Sat, 09 Nov 2024 01:36:09 GMT"} })
62482024-11-09T01:36:09.401ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
62492024-11-09T01:36:09.401ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
62502024-11-09T01:36:09.401ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
62512024-11-09T01:36:09.402ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62522024-11-09T01:36:09.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62532024-11-09T01:36:09.403ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 316.133885ms iteration = 29 status = {}
62542024-11-09T01:36:09.404ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 316.732332ms iteration = 28 status = null
62552024-11-09T01:36:09.408ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 321.273772ms iteration = 28 status = {}
62562024-11-09T01:36:09.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62572024-11-09T01:36:09.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62582024-11-09T01:36:09.448ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 68cb9c64-43d4-4c3f-ba7b-013513b8c68d, rack_id: 54080907-d4a8-4f65-b867-da4e2da6d2ba, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8166ae85-b9fa-427c-9f22-e997378e0527) } rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
62592024-11-09T01:36:09.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62602024-11-09T01:36:09.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62612024-11-09T01:36:09.458ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
62622024-11-09T01:36:09.458ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "df8da949-3186-4baf-bdf7-94bc620feddd", "content-length": "134", "date": "Sat, 09 Nov 2024 01:36:09 GMT"} })
62632024-11-09T01:36:09.458ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
62642024-11-09T01:36:09.458ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8166ae85-b9fa-427c-9f22-e997378e0527
62652024-11-09T01:36:09.458ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
62662024-11-09T01:36:09.458ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
62672024-11-09T01:36:09.458ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62682024-11-09T01:36:09.458ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62692024-11-09T01:36:09.458ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62702024-11-09T01:36:09.458ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62712024-11-09T01:36:09.459ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62722024-11-09T01:36:09.459ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62732024-11-09T01:36:09.459ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba
62742024-11-09T01:36:09.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62752024-11-09T01:36:09.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62762024-11-09T01:36:09.461ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
62772024-11-09T01:36:09.461ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4614f987-afbe-4078-bef4-4347072aaf1d", "content-length": "2", "date": "Sat, 09 Nov 2024 01:36:09 GMT"} })
62782024-11-09T01:36:09.461ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
62792024-11-09T01:36:09.461ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea886626-7d99-41ce-a6ae-b99672a23b64", "content-length": "52", "date": "Sat, 09 Nov 2024 01:36:09 GMT"} })
62802024-11-09T01:36:09.461ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch_location = Switch0
62812024-11-09T01:36:09.461ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
62822024-11-09T01:36:09.592ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "66e95c01-ecfc-4cd8-965c-21b15156ed7a", "date": "Sat, 09 Nov 2024 01:36:09 GMT"} })
62832024-11-09T01:36:09.592ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba switch = Switch0
62842024-11-09T01:36:09.592ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
62852024-11-09T01:36:09.592ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 54080907-d4a8-4f65-b867-da4e2da6d2ba result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "76d2b27c-71ad-4662-81fb-32c84a7798d5", "content-length": "682", "date": "Sat, 09 Nov 2024 01:36:09 GMT"} })
62862024-11-09T01:36:09.592ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62872024-11-09T01:36:09.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62882024-11-09T01:36:09.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62892024-11-09T01:36:09.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62902024-11-09T01:36:09.606ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62912024-11-09T01:36:09.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62922024-11-09T01:36:09.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62932024-11-09T01:36:09.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62942024-11-09T01:36:09.616ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 528.814746ms iteration = 28 status = {}
62952024-11-09T01:36:10.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 36ea94ba-d001-4374-9fd9-77403d09a8b7 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
62962024-11-09T01:36:10.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 36ea94ba-d001-4374-9fd9-77403d09a8b7 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
62972024-11-09T01:36:10.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2462 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 36ea94ba-d001-4374-9fd9-77403d09a8b7 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
62982024-11-09T01:36:11.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ede7b6b8-bc2b-499e-8be7-16e5181ca5e1 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
62992024-11-09T01:36:11.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ede7b6b8-bc2b-499e-8be7-16e5181ca5e1 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63002024-11-09T01:36:11.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ede7b6b8-bc2b-499e-8be7-16e5181ca5e1 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63012024-11-09T01:36:12.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4d2bca9a-88ae-4ba5-9ecc-732e4b405181 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63022024-11-09T01:36:12.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4d2bca9a-88ae-4ba5-9ecc-732e4b405181 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63032024-11-09T01:36:12.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4d2bca9a-88ae-4ba5-9ecc-732e4b405181 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63042024-11-09T01:36:13.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 454ed205-12d9-4c60-87b0-002bd79518bf roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63052024-11-09T01:36:13.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 454ed205-12d9-4c60-87b0-002bd79518bf resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63062024-11-09T01:36:13.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2552 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 454ed205-12d9-4c60-87b0-002bd79518bf response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63072024-11-09T01:36:14.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 73f39ab6-c6a3-416b-8d45-b965b53a78d0 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63082024-11-09T01:36:14.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 73f39ab6-c6a3-416b-8d45-b965b53a78d0 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63092024-11-09T01:36:14.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 73f39ab6-c6a3-416b-8d45-b965b53a78d0 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63102024-11-09T01:36:14.972ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1511 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = b3a287bd-d33b-4926-83bf-484355385401 response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
63112024-11-09T01:36:15.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = eae946e1-a429-4bab-8de5-c827fb22065e roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63122024-11-09T01:36:15.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = eae946e1-a429-4bab-8de5-c827fb22065e resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63132024-11-09T01:36:15.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2729 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = eae946e1-a429-4bab-8de5-c827fb22065e response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63142024-11-09T01:36:16.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d84bfc4e-25d9-4498-8b09-d5fc9bed7628 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63152024-11-09T01:36:16.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d84bfc4e-25d9-4498-8b09-d5fc9bed7628 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63162024-11-09T01:36:16.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d84bfc4e-25d9-4498-8b09-d5fc9bed7628 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63172024-11-09T01:36:17.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b48ef635-166b-4ab3-a619-34bee38576ab roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63182024-11-09T01:36:17.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b48ef635-166b-4ab3-a619-34bee38576ab resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63192024-11-09T01:36:17.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2767 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b48ef635-166b-4ab3-a619-34bee38576ab response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63202024-11-09T01:36:18.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3c580f88-998b-4c47-a3ed-551b7001ae31 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63212024-11-09T01:36:18.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3c580f88-998b-4c47-a3ed-551b7001ae31 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63222024-11-09T01:36:18.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 3c580f88-998b-4c47-a3ed-551b7001ae31 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63232024-11-09T01:36:19.087ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
63242024-11-09T01:36:19.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63252024-11-09T01:36:19.087ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
63262024-11-09T01:36:19.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63272024-11-09T01:36:19.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63282024-11-09T01:36:19.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63292024-11-09T01:36:19.089ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63302024-11-09T01:36:19.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63312024-11-09T01:36:19.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63322024-11-09T01:36:19.091ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.317148ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63332024-11-09T01:36:19.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63342024-11-09T01:36:19.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63352024-11-09T01:36:19.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63362024-11-09T01:36:19.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63372024-11-09T01:36:19.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63382024-11-09T01:36:19.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63392024-11-09T01:36:19.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
63402024-11-09T01:36:19.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63412024-11-09T01:36:19.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63422024-11-09T01:36:19.108ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
63432024-11-09T01:36:19.108ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.035105ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
63442024-11-09T01:36:19.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d6b9fe0d-ff6b-41c5-8920-3387e525b149 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63452024-11-09T01:36:19.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d6b9fe0d-ff6b-41c5-8920-3387e525b149 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63462024-11-09T01:36:19.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d6b9fe0d-ff6b-41c5-8920-3387e525b149 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63472024-11-09T01:36:19.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = c576ba81-39bf-41b7-b566-7c1d80b3a3e3 roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
63482024-11-09T01:36:19.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = c576ba81-39bf-41b7-b566-7c1d80b3a3e3 resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
63492024-11-09T01:36:19.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = c576ba81-39bf-41b7-b566-7c1d80b3a3e3 response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?sort_by=id_ascending
63502024-11-09T01:36:19.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = b78cad06-344e-4c30-98de-8c053985b7d3 roles = RoleSet { roles: {} } uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
63512024-11-09T01:36:19.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = b78cad06-344e-4c30-98de-8c053985b7d3 resource = Database result = Ok(()) uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
63522024-11-09T01:36:19.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54093 req_id = b78cad06-344e-4c30-98de-8c053985b7d3 response_code = 200 uri = /metrics/collectors/c1f5f1ac-115a-4364-9c55-c9fb1352920b/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTlkNGUwOC1kMTMxLTRkMTEtODI0NC02NjI5MjNkZDkzNTcifX0%3D
63532024-11-09T01:36:20.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8f2d3b12-c135-4657-a7f1-bf13857a43d9 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63542024-11-09T01:36:20.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8f2d3b12-c135-4657-a7f1-bf13857a43d9 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63552024-11-09T01:36:20.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2075 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 8f2d3b12-c135-4657-a7f1-bf13857a43d9 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63562024-11-09T01:36:21.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d66650f0-5b66-4180-9f0a-45472ee5a961 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63572024-11-09T01:36:21.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d66650f0-5b66-4180-9f0a-45472ee5a961 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63582024-11-09T01:36:21.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2150 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = d66650f0-5b66-4180-9f0a-45472ee5a961 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63592024-11-09T01:36:22.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2e27ac76-c11c-4718-b725-8018f8496680 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63602024-11-09T01:36:22.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2e27ac76-c11c-4718-b725-8018f8496680 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63612024-11-09T01:36:22.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 2e27ac76-c11c-4718-b725-8018f8496680 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63622024-11-09T01:36:23.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6a636e9e-6a6c-49fd-a357-8346f45d72f5 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63632024-11-09T01:36:23.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6a636e9e-6a6c-49fd-a357-8346f45d72f5 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63642024-11-09T01:36:23.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 6a636e9e-6a6c-49fd-a357-8346f45d72f5 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63652024-11-09T01:36:24.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = cb351792-8ff2-4592-85c0-4f3c5f2adc6c roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63662024-11-09T01:36:24.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = cb351792-8ff2-4592-85c0-4f3c5f2adc6c resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63672024-11-09T01:36:24.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2535 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = cb351792-8ff2-4592-85c0-4f3c5f2adc6c response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63682024-11-09T01:36:24.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 884c5e12-45e8-4c44-bae4-d2e57e1b7b6d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
63692024-11-09T01:36:24.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 884c5e12-45e8-4c44-bae4-d2e57e1b7b6d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
63702024-11-09T01:36:24.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2900 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44908 req_id = 884c5e12-45e8-4c44-bae4-d2e57e1b7b6d response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
63712024-11-09T01:36:25.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b1c57a55-171c-49a8-9117-7a2d17f08376 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63722024-11-09T01:36:25.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b1c57a55-171c-49a8-9117-7a2d17f08376 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63732024-11-09T01:36:25.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2589 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b1c57a55-171c-49a8-9117-7a2d17f08376 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63742024-11-09T01:36:26.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = dcebe650-c4f7-4e35-83b8-e02c90530bf2 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63752024-11-09T01:36:26.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = dcebe650-c4f7-4e35-83b8-e02c90530bf2 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63762024-11-09T01:36:26.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2734 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = dcebe650-c4f7-4e35-83b8-e02c90530bf2 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63772024-11-09T01:36:27.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b238f0a8-edb2-4d21-8dc5-20894f30c581 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63782024-11-09T01:36:27.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b238f0a8-edb2-4d21-8dc5-20894f30c581 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63792024-11-09T01:36:27.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2012 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = b238f0a8-edb2-4d21-8dc5-20894f30c581 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63802024-11-09T01:36:28.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ec6aa757-5d44-4438-8a9d-c57f393b1b3a roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63812024-11-09T01:36:28.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ec6aa757-5d44-4438-8a9d-c57f393b1b3a resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63822024-11-09T01:36:28.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2543 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = ec6aa757-5d44-4438-8a9d-c57f393b1b3a response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
63832024-11-09T01:36:29.087ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
63842024-11-09T01:36:29.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63852024-11-09T01:36:29.087ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
63862024-11-09T01:36:29.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63872024-11-09T01:36:29.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63882024-11-09T01:36:29.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63892024-11-09T01:36:29.089ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63902024-11-09T01:36:29.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63912024-11-09T01:36:29.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63922024-11-09T01:36:29.091ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.312168ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63932024-11-09T01:36:29.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63942024-11-09T01:36:29.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63952024-11-09T01:36:29.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63962024-11-09T01:36:29.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63972024-11-09T01:36:29.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63982024-11-09T01:36:29.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63992024-11-09T01:36:29.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079, lookup_type: ById(33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079) } result = Ok(())
64002024-11-09T01:36:29.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64012024-11-09T01:36:29.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64022024-11-09T01:36:29.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 original_time_created = 2024-11-09 01:22:29.116269 UTC target_id = 33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079 time_created = 2024-11-09 01:22:29.116269 UTC
64032024-11-09T01:36:29.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.887163ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"33e7d2cd-ad13-4fd4-a8b4-dc6cd7159079","time_created":"2024-11-09T01:22:29.116269Z"}
64042024-11-09T01:36:29.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = fa7c60af-1e96-4719-84e3-7649d07ce6b7 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
64052024-11-09T01:36:29.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = fa7c60af-1e96-4719-84e3-7649d07ce6b7 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
64062024-11-09T01:36:29.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1980 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = fa7c60af-1e96-4719-84e3-7649d07ce6b7 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
64072024-11-09T01:36:29.972ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1751 local_addr = [fd00:1122:3344:101::b]:45524 method = GET remote_addr = [fd00:1122:3344:101::d]:56483 req_id = 4e03643e-5012-450d-8e00-013c233256ed response_code = 200 uri = /02562f58-d954-43f9-93a1-2ae8426ccbe9
64082024-11-09T01:36:30.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 72480ba9-aa5b-4500-97df-c352d51fd092 roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
64092024-11-09T01:36:30.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 72480ba9-aa5b-4500-97df-c352d51fd092 resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
64102024-11-09T01:36:30.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2682 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 72480ba9-aa5b-4500-97df-c352d51fd092 response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
64112024-11-09T01:36:31.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4ea7fca4-627c-4aa2-96a6-59c7bea84b8d roles = RoleSet { roles: {} } uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
64122024-11-09T01:36:31.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4ea7fca4-627c-4aa2-96a6-59c7bea84b8d resource = Database result = Ok(()) uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813
64132024-11-09T01:36:31.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:46575 req_id = 4ea7fca4-627c-4aa2-96a6-59c7bea84b8d response_code = 200 uri = /probes/8c24f6fb-cc5e-4758-a216-4357bbb5d813